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ABSTRACT 



This quid-book is designed to help school districts 
plan evaluations Of -the'ir curriculuB. proqr^am. It is. divided into four 
■ aior sections.. The' first s^c.icn pr^s-ats a cas- stud^ based.on the 
experiences of ^ school, district that us-.i this handbook m planning 
an evaliration. The s-.cond section reproduces the set of forms that 
th- school distrfct Planning qroup compli^ted- Th- third section gives 
bri«f instructions for completing *he s-^en torms. The last section 
offers'advice on 'hot* to select a ^technical consultant who can a^ist 
in conducting the planned - valuation._fin.^lly , App^hdix A contains 
master'. copies of the .forms tc completed in planning the- ' - 
evaluation; Appendix B^'off-cs a set of ca-cklists to be used m 
cOBpletinq certain loruis. . (.Vufhor/LD) - ^ ' 
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Purpose of the liandbook * ' r' ' 

Fkrmbig A-PrOpam f valuation: An Educator's Handbook is designed to help 
sdiool districts plan tlicir /curriculum' program evaluations. Use j»f this handbo&k 
placcTeT^uation plaiiiing in the' hands of those persons in the district who want a 
program evaluation and who will use its results. When Siese persons-participate in 
planning, it is Ji^cwe. likely that information collected about a program will be more 
directly relevant to the purposes of its evaluatioTi. 

We.empSsize that this handbook .deals wth.evaluation planning, not with (he 
.details of executing, the plan, Conducting the evaluation, once'the plan is deveMped, 
will probably, require technioffl expertise. This expertise in data collection, analysis, 
and interpretation is often available from within a district. When it is not, then the 
planning group must consider the use of putside assistance. . i 

Deciding to use the handbook ^ 

* Yhere'are certain considerations that should be revie<ved before deciding to use 
this handbook. These considerations deal with the purpose of the evaluation, the 
commitment of sfaff <o the planning effort, time heeded to plan the evaluation, and 

costs. * • * ' ^ ' 1, ' ' 

Purpose of the evaluation. Evaluations ar^ conducted for many purposes.^The 
remits of evaluations are used to decide whether a program should be continued, 
eimed, or chang^;- results are used to» inform districts whether goals are being 
aciiieved,.'<or wh^her key program features are being appropriately implemented. 
Evaluations 5ften ^e carried out as part of staff development, or to promote the . 
visibility of a program or to comply with Evaluation requifements tied td program 
fundi^. Critical purposes niay be hidden. In any case, the use of this handbook 
starts with expHcit statemeiAs about the purposes of the evaluation to be planned. 

• Are there clear purposes for planning the evaluation? 

Staff commitment. Planning A Program Evaluation is intended for use b^ a 
small grouj).of persons within the district who represent both those concerned with 
the curriciilum program being evaluated /and those who will u$e the results. 
Co'inmittee members shquld be chosen who are able to make the 'commitment of 
time and effort which the planning process will^equire. The committee also should 
not be too large; too many members make it difficult.to schedule meeting times.so 
that all can |iarticipate. * , . 

One. person from the district should be chosen to act as coordinatpr of the 
planning group; he has the responsibility for organizing and managing the planning 




activities. The coordinator should have good interpersonal' skills, credibUity ^ith 
other teachers* and administrators, the ability to. manage the resources needed to 
conduct the planning effort, and skills in problem-solving and communication. It 

• helps, too, if the coordinatgr has some experience orjraining in research design, t^st 
and ''questionnaire construction, data analysis, and report writing. Ideally, th^ 
coordinator of the planning effort should ^^l.so supervise the conduct of the 

vcvaluation. ' . ' ' 

• '■ Are persons in the district zvfdWp to serve as committee members? 

. • Is a committee coordinator available to iead the planning committee? -y 

• Is the district willing to allocate necesssary staff time for this ^ff6rt? ^ 
Time Schedule. A definite time §cH€dide is necessary for completing the s 

' in the* planning process. Time should '^se be scheduled for orienting the plan 

' group in the use of the handboc*i?and for administrative review of .the ! 
evaluation plan. A time schedule wiU h^planning group members to arrange th€ir 
time and to keep group discussions within definite limits. ' 

The time schedule ^hould spe^fy a datfe when the final evaluation plan should 
be completed and when the planing meetings v/^J)i^ht\d, Some planning groups 
work thrijugh the entire handbook in two or three days, meeting all day epch day. 
Othe<fcispread the work over as long as six months, holding three-hour meetings once 

*'"^or twice a month. The shorter process generally costs less. However, it may be 
difficult for planning group members to find a solid block of time when all are free 
to'participate. The longer proeess give^ ^jhnning group members time to think Bhout 
and review the forms. However, too much time between committee meetings often 

■ results in the committee spending too mucktime in reviewing and recalling previous 
work 

There are two common wa^'s to s*dule the planning process. In the first, the 
planning group is appointed at the beginning of the school year in order to use the 

• handbook during the fall. During the rest of the school year, the coordm^tor and a 
. technical consultant pilot test the plan. ^The full-scale evahiation is thenTully 

implemented with the beginning of the new ^chool year in September. A second way 
is to plan the evaluatio^n during the spring or over the summer break, and then to 
implement the evaluation plan with the beginiiing^of the new school year. ' 
• Can a realistic time schedule be developed? 

0;.?/5 Costs associated with using the handbook should be considered before, 
deciding whether it should.be used. These should include anticipafed costs for 
releJTstf* time or substitute teachers, secretarial and clerical expenses, and costs for 
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^upHcatiiig forms and committee documents. Costs for the Committee 'members' 
cmntation/ttaining, and planning meetings should also be realistically e^imated. 
Questions to. be answered by those responsible for deciding toAise the handbook are: 

• Have costs in usiafc the handbook been cdnsidered?^ • 

• Can these' costs be underwritten by the school district? 

r If all the questions listed above can be answered "yes," tl)en it is likely that a 
Ustfict will be able to use this handbook in planning a program evaluation^ 

plannmg process ' \ 

there are five steps in the,,pianhing process. In the fu^t step, the committee 
dariflw the questibhs and poncems that led to the decision to plan the prograi^ 
evaluation. In other words, the purpose tbf the*T)roppsed evaluation is stated at this 
tiipc ^ that all committee members agree upon a common frame of reference. ' ( 
The second step taken br the cpmn^tee is to summarise basic facts about the 
program to be evaluated. These basic facjs refer to the nime of the fwogranl, the 
location and grade levels of its.pupils, then: numbers, it staff , and thp* name and title 
of its director. 

The third step begins by identifying program elements that are considered bv 
the committee to be relevant to the concerns and questions listed in step one. Th'eser 
program elements are classified into categories reflecting student outcomes, 
curriculum content, content sequence, instructtonal approach, and program support. 
A detailed description of each relevant program element is developed. 

Steps four and five huild upon step three. In step four, the relative ifnportance 
of each relevant program element is determi«ed and the most important onfes are 

V selected for further attention. In step five, data collection requirements are specified 
for each retained element, and judgment criteria are developed for interpreting the 
data -to be collected. 

Forms are associated with each of 4^iese steps. The sef of completefl forms 
constitutes the evaluation plan. There are seven forms, ti^ed as follows: 
Vorm 1 - Clarifying Concerns and Questions 
Form 2 - - Summarizing Basic Pi^am Jnformatibr\ 
^orm 3A - Student Outcomes 
Form 3B - Curriculuili Content • 
Form 3C - Content Sequencing 
Form 3D - Instructional Approach ' ' 





Form 3E - Ft^&m Support 
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Fonns 3A thiough 3E each have three parts. Part 1 helps to clanfy the mtenoea , 
S,™m element Part-2 rates the relative importanstof eaA program e ement; and 
totTsSes data coUection requirements and judgment cHtena> mterpreting 
SfdLTbrcoUected. hgure 1 illustrates the klationships between the and 
t fo^and shov. the order in which-the forms and their parts ^ ^mplet^- 

Haw many copies of each 'fonn are. completed depends <>" "fj"^* *™ 
number of 9onLs and elements. Several program elements may ^erdated to one 
concerh. and one element may be related to several concf ms. 

Overview of the handbook ' . . 

. TTiere are four majorwctions that foUow in this handbook.^ ^ 
■ Study - Narrative. TWs section presptns a case rtu^y based on the 

expen^ce ofl' chbol district which used this handbo<Jk in pl^fiSmg an e,v» _ 
EctTon. and thr examples which follow, should be -d -efuDy before any 
attemot is made to begin the planning process or opraplete We forms. 

to Zdi- Examples. TTiis section presents" the^t of forms wtech the school 

district planning gro"P completed. . u • r • ♦«,.*;^c fnr 

instructions for Completini Fonm. This action pr^ents bnef ^s^rt^ ^ 
completing the forms. The instructions are giveft in the order which the forms ^ 

'"'^'siSmg Further Assistance. This brief section presents advio. on how-to select 
a tecScar consultant who can assisf in conducting the evaluation-wbch has been 

""""ie are alsct two, appendixes. Appendix A contains master copies of the 

TcompJeting fo4 dealing with curriculum content, content sequencmg, insttuc. 
tional approach, and program support. ' . ^ ^ 



Sttp I ■ Clarifyin^f oncerhs 
and Questions^ 



Step 2 - Swnniarizing Bjsic 
Program Information ' 



Step 3 Clarilying Intended^ 
Program Elements 



Step 4 "^Setting Priorities for 
' Further Planning 



Step 5 - Planning to Gather 
and Use Evidence 



Form I 
Clarifying Concerns 
>and Questions 



Form 2 
^fummarizing Basic 
Program Information 



Form 3A 
Student Outcomes 

^ Parti 
Qarifying Intended 
Student Outcomes 



Form3A 
Student Outcomes 

Part 2 ' 
Setting Priorities for 
Further Phnning 



Form 3A ' 
Student Outcomes 

Part "3 
Gathering and . 
Using Evidence 



FIGURE I * ^ V ^ 

Coijipleting the Steps And Forms For Planning A Progniiti f valuation ^ 
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Form 38^ 
Curriculum Content 

Pirt 1 
Clarifying Intended 
Curriculum Content 



Form 3C 
(Jontenf Sequencing 

Parti 
Qarifying Intended 
Content Sequencing; 



Form 3D , 
Instructional Approach 

Partflj" 
Clarifying Intended , 
Instructional Approach 



' Form 3E 
Program Support 

Part 1 1 
Clarifying Intended 
Program Support 



Form 3B 
Curriculum Content 

Part 2 
Setting Priorities for 
Further Planning 



Form 3C 
Content Sequencing 

Part2 ^ 
Setting Priorities for 
Further Planning 



Form 3D 
Instructional Approach 

Part 2 
Setting Priorities for 
Further Planning 



Form 3E 
Program Support 

Part 2 
Setting Priorities for 
< Further Planning 




Form 3B 
Curriculum Content 

Part 3 
Gatheringpnd 
Using Evidence 



Form 3C 
Content Sequencing 

Part 3 
Gathering and 
Using Evidence 



Form 3D , 
Instructional Approach 

Part 3 
Gathering and 



Using Evidence 
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Execute Plan 
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bitroductiort . K' ^ - . 

. This case study is based on. an actual planning effort conducted during ^he 
1976.77 school year by a district' ia;soutlieastbrn Pehnsylvania. Tlie names of the 
town and the people^ involved have tfe'en changed and the names^of the curriculum 
pro^m and the standardized teSts'are alsa fictional, Observat^KR^S^ere made pf all 
planning jneetings over a period of about four months^afid car^ Ip^ords were kept 
of their work. In this case' study, theu-^ctji^^^ in summary form 

as one contiifuous effort. ^ . - V / \^ 

Ail committee members should re^OHhf cast; ^itudy carefully pfior ta.tfie first 
meeting. It is useful Asij/old an- orientationMneetirig to discuss the planning process 
and the case"" study, and to confirm pracUcaT details such as the schedule of 
'committee meetings. ^ . 

Situation ^ ^ 

As Science Director of the Belford Public Schools, Walt^Powell supervised all, 
science instruction in the district. For some' time, he hud been concem'^d about the 
distnet^s ninth grade science program, calle(J the Science Curriculum for Individuali- 
zation fSCI), and had made a number of modifications. toMt over , the years to fit 
local needs and policies. ^ ' * 

• Powell had held discussions wi^th the Assistant Superintendent for Curriculum 
and had heard complaints from the teachers vyhp were using the program. The chief 
problems centered on the low level of student achievement; on lacFrof materials and 
facilities; and on issues of methods and content. There was consensus that some 
improvement (jf the ninth grade SCI program should be und^taken. 

Because the discussions had been largely based on impressions and unsyste- 
matic observations, Powell decided that before any improvement effort could be 
undertaken, it would be- necessary to evaluate the program and collect reliable data 
on its actual status. \ > % - 

He selected Planning A Program J^valuatiorp; An Educator's Handbook for help 
in planning the evaluation because- he felt it provided a structured, systematic 
method of planning the evaluation; it presented a way to involve the program^s 
teachers In the planning , and later data collection efforts; and would increase the 
"tikfelihood that they would use the results to improve the program. . :irr, 

• He decided to ^ppoint all five full-iimc teachers who taught in the ninth grade 

include^Tn making his plans, Powell schcduled'the planning meetings to take place 
from September 'to December, with administrative review and final approval of the 



mai«iv hv holdine meetings on in-service training daVs or by using s"dsiuuic 

for thZ H gave ttfem copies of the handbook, reviewed the plannmg P^o^^s 

concerns and questions about the program. / • ^ 

■ * / ' ' - A 

"Step 1 : Clawing toncernsand QueJfions on Form 1 ; 
At the first meetin'gX'committee ha4/little trouble arriving at « 
list of oncems about the ninth grade SCI P^o^.^" ^^7" P:^::"^:^^^^^^^^^^ 
, Jncluded concems»about student c(5fenit.ve achievement, f "^^"^ 
^ience the district's student groumng policies and their effect «i 'rtude^t 
:^LTvemen^^e4. the lac. of ProP#!alK,ratory mat^a^^^^^ " 
student use. and discrepancies between the intended methods and activities 
•brogram and those actually used by teachers, y . „ . ^ ^ 

All, five teachers' echopd these concerns but added others such as a. lacK oi 

workboklteril^ 

Tab work and confusion on the course's content and the ^"^"'^J f I^^'Vj^^^^^^^ 

T^ev miicklv realized that the number of topics was much too lortg t6 be 
handS^easir; In ttir icussion, they tried to combine related o; overi.pP^g ^ 

'""'tr example student cognitive achievement and student 



diverse* sources as 3 informal surveys, observations mijjje by the Science Director, 
informal discussions among teachiprs, and .simply the logic of the situation, tliey 
summarized these "Jlivefse spurces briefly Mttm 2. of Fomi'l fbr each conceqi^ 

. the five comm'ihee members then Juried to convert their ^concerns intoNiiore 
sijecific questions, which could be^aoswet^B by the evaluation. As coordlhator, 
Powell was immediately faced with two probl&ms. First,, the cnommittee w^s simply 
suggesting too many questions- far .more than the evaluation.covld possibly ^answer, 
atid, sect>nd, some of ihc questions were too vague or too'dctailcd, or outside the 
scope of %p evaluation. He reminded the committee that th'is wafi'^their first attempt 
at cA^ctlng an evalyationN|ijd that they should try to keep their questions as few 
and as^^ple as' possible. More complex questions might be answered in. later 
evaluations of the program. He led the committee to simplify .some questions and 
combine others. . . r 

> , Still; there Were sortie disputes among the committee members. Ira Dayton 
wsinted to compare local student /^rformance with tlie performance of students 
around the country. This plearly ^Implied usiog a nationally standardized test. Vic 
Noite felt that sudji'te^ts measure objectives that did nofmatch the local ones set by 
the teachers. They compromised by asking both questions. Joan Cohen pr6posed a 
question regarding sex differences in attitudes towards science, since it was her 
obsmation that the students viewed science as a svile field. One particular problem 
arose in the^concems about methods and activities. Originally, the committee 
wanted only' to have; teachers report on what methods and activities they used. 
Powell, however, said that he had often ' observed classes and that it was his 
experience that teachers did not always do in the classroom what they thought they 
.were doing. Therefore, he, wanted to put in another question to compare what 
teachers said they did with what an obsen^er actu^Jly saw them doing. The 
committee was at first rellictant to accept this, but after some thought agreed to 
include it. They summarized their questions in Item 3 of Form 1 . 

•' ^ - ■ < .X 



The committee's completed copies of 
Form 1 are on pages 2fe to 30. 

Review these now before proceeding to 
Step 2. \ 
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' Step 2; Summarizing Basic Program rnformation on Fprm 2 

.' Completing Fofm 2 - Sjummarizing Basic Progr>m Information was very easy 
ai first. Parts' 1 a*nd 3,of the form, which dealt with its title, ^o"tent reference 
books, and stiffmg xvJre fairly obvious (although not everyone remembered that 
there were lists-oflahjwtives and' materials). ^ . . » n^»nt 

Part 3 howere^, produced the problem of how to report student enrollment. 
"^ At first Vic Nolte wanted fo list orily^eneral estimate of the; numbjer of students, 
"IbLut" seven bundled,", he said. Daytol however, suggested that if hey we.^ to 
give a standardized test, Oiey^would have\o know how many-cop.es t? ^de^ 
wanted an exact figlre.^Les E«her remindVih^mittee that they-wanted to . 
'Xre students i^'the SCI ^^m to those inli^^ 
and therefore needed to know Kow "^^^V 

Cphen ^Iso want^ to know how many boys and girls wer^ la each o the ^luee "mth 
grade science programs.' Bill Armstrong thought that it might be "^cful in 
' Cerpretini student outcomes to know to what ex^nt white, black, apd 
Shipeaking studehts differed, if at all. on measures of student outcome, and 
wanted a listing of student? by raciat/ethnic group. 

Walt Powell was able to searches records and provide breakdowns by science 
program and by sex, but he could only fmd percentage breakdowns on racia /ethmc 
composition for the North Junior, High School. These breakdowns, were enterejf m 
Item 7 of Form 2. • ' . ' * ^ 




The committee's completed copy of 

Form 2 is oa page 31. 

-Review this now1)efore proceeding to 

Step3r 



step 3: Dcsc^ing Intended Progi^m Element^^ . j ' . >. 

Lu* Powell had assembled stacks of blank copies of Forms 3'A through 3E so that \ 
tfie-members.would have sufficient copies to use for describing intended program 
elements. Lowell reminded them that they should not ^empt to describe in detail 
ali the elements of the SCI .program, only tlfcse .WhicV they thought vTere- mo^t ^. 
relevant to their list of c^erns and questions. - 

• Powell distributed copies of Form 3A -^Student Outcomes. The committee at 
first considered and then rejeated infounaifcn^recall as a type of outcome which was 
related to their concerns and. questions. The program had many such objectives, but 
the conunittee bfclieved that information recall was less relevant to their concerns • - 
than basic skills and higher order processes such as problem-solving. * 

" They alsa ii^luded atjitudft as a relevant student outcome. Some dispute 
occurred overjsiipport sk(lk as a outcome. Ira Dayton felt that it was important and 
should be included because teachers had complained of discipline problems, and . 
believed this type of outcome was, related both to student attitude's and mefhods 
and activities. For the moment, the committee agreed to keep it in. The committee 
competed Part 1 of Fortf 3A by restating each selected outcome in more specific 
terms and by writing representative student behaviors associated with each. 

Before beginning work on Form 3B - Curriculum Content, Powell suggested 
that the committer's work would be simplified if they reviewed the checklists m 
Appendix B before selecting further elements relevant-to the evaluation. At first, the 
committee was confused by Form 3B since, to spme extent, the SCI program drew 
on all these sources of content. Powell thought they should narrow their view a bit 
and select only th^ sources and types of content with which they were most 
concerned. After more discusion, they narrowed their interests to' traditional 
academic disciplines and' personal experiences of students. They finished Part 1 of 
Form 3B by specifying types of content from each of these two sources which they 
felt the SCI program emphasized. They also gave a brief explanatioH^heir reasons 
for choosing these sources of content as important for the prografn evaluation. Les 
Fisher wondered why they should write their reasons for emphasizing these types of 
content. Powell explained that written reasons were useful both for explaining the 
program to a technical consultant who might assist in the execution of the 
evaluation plan, and for interpreting evaluation results. 

Because content sequencing was directly related to the curriculum content, the 
committee completed one copy of Foj-in 3C - Content Sequencing for each type of 
content they had listed in Item 1 b of Form 3B. They had listed a total of five types 
of content, so they completed five copies of rorin 3C - ConTent Sequencing. Again, 



ERIC 



the committee had the problem of choosmg which sequencmg P'^'^'Pl" ^ 
emphasized since all of thert. were used to some extent. Usmg the checkhst m 
Appendix B-2 helped them to organize their thinking. A-fler some discussion the/^ 
. a^eed the most important Sources of sequencing pltociple, to be evduated 
were the logical structure of existing knowledge (facts, key concepts and rules and. 
^1 tionshipT) and- assumptions about the psycho.logy of learning (-^thods and 
Drocedutes and student interest or purposes). , They Completed Form 3C by 
s^ecTfy^co"^^^^^ sequencing principles fo. e.ch type oT^onfent ,nd their reasons 
for emphasizing these principles. - • - ' • , ' ^ed' the 

^ Completing the fonns»on instructional approaches (Foniv SD) provoked the 
longest discassW of all. EverytWqg on thef 'checklist seemed somehow to be 
rSnt. ?^u^^ey had to-make sc«.e hardUoices about wlfet nught be most 
e evan for tjidr eilttation concerns and questlijns.'The checklist in Appendix B-3 
w s help u^^ app,oact,e.a].d strategie.^ committee easily 

Teed to eliminate learning objectives; the assessment -^3^^^"^ ^^^^ 
nieds were also seen a« not particularly relevanUc^e.r concerns TT;ey m t ally, 
considered placement as relevant to their concern about student grouping, but hey 
^^jected this as being more appropriate for a -ncen.. abput placjng stu^^^^^^^^^ 
one course of instruction, npt about placing students in either the SCI, physics, o 
tology prdkrams. They also rejected pacing and performance evaluation as not 

mre was some disagreement over whether instructional settings and rtudent 
and ^acher r'Js wer* very relevant. Vic Nolte .felt that they ^^^^^^f^^^ 
interested in how student? weYe engaged in the learning process and how teachere 
aiid ldents inter cted, and not so much in specific functions wh.ch.each 
oerfoS L Fisher iid not want to include instructional settings since,' in 
or ct cT ther^ was little variation in settings and he felt it was not .particularly 
?elevrt\o t^^^^^^^^^^^^ The rest of the committee, however, wanted to retam it, 

at least rone enough for.the priority ratings later on. ... ,u u.a 

Because of ?he large number of approaches and f^^egies which they had 
Checked Powell assigned one or two a«>proaches to each committee member and 
sked that member ^o write a brief paragraph on the reasons why these strategies 
Could be emphasized in the SCI program. After they were wntten, the committee 
rSl-each one and modifications were made as needed. ■ , . th,„ 

The last form. Form 3E - Program Support, was fairly easy to comp ete. The 
committee picked facilities and student grouping as the onjy "P^^^'^^^^f '^'^^"1^° 
their concerns. They had first thought to include materials management but Bd 
Armstrong said that what they were really interested m was the presence or4atk of 



such materials, no|^th the system for ordering- them or^ making them accessible. 
They li\tecl 'the relevant Support System Strategies (from Appendix B-4) Und the ^ 
reasons for thepu ' . ' \ ' * 

Powell had the handwritten fornis typed lip and reproduled for each 
' committee member. ^ , ; 



... ..___jh?ia 

Review Parta-of Y^esc. 
proceeding tor S4ep 4.'* 



The committee's cflBU^l'§S|^i%^ 
Fomii3M^toURhWa*^ 32 to 52.. 



is now before 



• step 4 - Settihg Priorities for Further Planning on Fonris 3 A to 3E, Prfrt 2 
^3!^^^£rdinator jdistributed typed copies of Forms^ 3^A through 3E to^e 
committee niember. Hfe instructed tKem to^o through th^^et and complete Part 
Setting Priorities for Further Plannirig on each form. He asked them to conSidet 
highly related each element was to the list of concerns and questions. While all were 
considered relevant to some extent* some would be more highly related than others 
to the l^st of concerns and questions. The committee had named 21 eler^gnts, which 
was certainly too many to handle in one evaluation; some would have to be*, 
eliminated. , > 

Each member of the committee made his or her ratings of each element. When*^ 
they were finished, Powell led them in examining and discussing their ratings. To 
speed the process, IJpwell suggested that any element which received high ratings ^ 
(either 4 or 5) frpm all of them be retained with little or no discussion. Elements 
which received low ratings (1, 2, or 3) from all six would be dropped with little or 
no discussion. The committee would discuss elements whose ratings were mixed and 
try to arrive at a consensus. . ^v , 

During the discussion, one item was rated low by air^he members. That was the . 
element of facilities undar the category of Program Support (Form 3^). Since t'he 
last meeting, it. had been announced that the ninth grade would be moving into a 
new huilding. Consequently, questloTiJi on the adequacy 'of faciliti^^ in the present 
building were not .relevant, and since the new building was not yet complete, it. 
was not possible to examine the adequacy of its facilities^-' 

Besides facilities, there vvere six other elements on whic& the copimittee 
members' ratings disagreed. The first was- support- skills in the student outcomes 
category. Everyone but Ira Dayton had»4'ated it 3 or lower. Ira still felt that student 
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discipline and supl,ort skills were important to' the evaluation, but ofher WmbeR 
S that support skflls wer. not di^^ly related to the concerns abqut^^^^^^^ 
Student achievement and had not S^S n»entioned explicitly ^er They al«, 
?elt thaUhe element was relatively less imW^nt tl&n the other three elements of 
btic sX higher order processes, and student attitSes. Ira agreed to go along wrth 
the comnlttee's opinion and support skiUs^ioined facilities in being dropped frorfi 

"^SillTt'-category of instructional approach, ratUigs of the i^pArt^^^^^^^^^ 
student motivation, insJructional settings, media, W^'*^^^^^^^ ' 
Drimarv roles of teachere showed some disagreement: Three persons tod rated 
SenT motation low, saying that their -al -n-n, ^as wit^^^^^ 
interest in science, not with the motivation techniques teachers use. Student 

"°"Sy"?Ze1^^^ judged instructional settings lo be irr^ev.nt. On review.^ 
they crnclUXTt it was Jt as highly related as other elemfentl-to the concerns 

\":fptot SSttruPtional media low, believing it not^impoi^nt . . 
other dem'ents. However, the rest of the committee felt that ^JV-^^J^^^^ 
know whether proper workbooks and lab equipment were available and whether 
^ache.^ were using it. The coordinator -was P^^icularly Merested ^^^^^^ 
remain since he felt the evaluation might provide evidehce of a need for an increase 
in budget for sach materials. The'e^ement of instruction^al media was kept _ 
. T^e elemeVits of the primaif rolfes of students artd pnnriary rOle of t^^^e" 
were discussed together, since members had tended to r<l^each,elementhi^or low 
for theTme reas^^^^ niose who had rated these two element, low had come abound 
to Vic NoTte', previous point that they were really mpre interested in methjxls and 
actWiLv aiid'not so much with specific role functions. After considerable 
discussion on the point, these two elements were dropped. 

''"Tus, f"fleen'of the original 21 elements were --Pf.^^. ^^JJ^^^^^^^ 
the coordinator for further, planning. The six that were ehminated were filed away 
for possible use in future evaluation efforts. 



The committee's completed copies of 
Forms 3A through 3E are on pages 32 to32. 
Review Part 2 of these-forms now before 
proceeding to Step 4. 



»Step 5: Specifying D^ta Sources anSd JudgmenbCriterij on Forms 3 A to 3E, Part 3 

Tht coordinator told the committee that their task now was to complete Part 3 
of Forms 3 A through 3E fey proposing specific data sources for each of the elements V 
remaining in the planning process and to establish- criteria by which such data would 
be interpreted in relation to the original fist of concerns and questions. BeTore 
^beginning this step, he reviewed with them a list of possible data sources (included in 
tl]e handbook on page 68). The group Was surprised at the possible rghge of such 
sources.'Most had thought chiefly in terms of tests and questionnaries, and had not 
considered observation cl^i^fcklists, fogs of activities, student records, and other 
possible sources., ^ . * . ^ r 

^JTie comirtittee had little trouble suggesting data sources for student^ outcomes 
(F&nTi'3A). Previous* discu^ons ha* already implied both a locally Constructed 
Objectives referott^ and a nationally standardized testi^ basic skills. They felt 
that thi§' wjauld enabje-them to compare the performance of tneir students with that 
of other sti^lfcnts aroi^'^ tiii^CQuntry, and also measure their perp^mbnce on locally 
important objectives! Howe vgr/^W, did not 'feel confident ta construct ^ test on 
soientliic . probleniv-solving, and- thus indicated* they w9uM use a proWem-solving 
subtest of the" standardized test. Initially, however, tlj^ey wanted to set their 
measurement criteria very high. They wd^ed 75 percent afctheir students to achieve 
above the 75th percentile. Powell explained to them^at such" a criterion of 
performance was completely unrealistic, and that few districts in the country could 
show this level of student achievement. It was especially unrealistic for the ninth 
grade SCI classes because the. brighter students were tracked into the physics and 
biology classes. Finally, the committee agreed to set performance standards that 
matched the national standards; i.e., half their students would score in the top half 
of the spore distribution. They also knew that the standardized test would provide a 
service^ll^gich would* break down scores by sub-groups such as sex, race, and so on, 
for sitili farther analysis. 

The locally constructed test was another matter, however, since in effect the 
teachers taught to the test. For this test, three-fourths of the students were to get at 
least 80% of the items correct. 

. The committee immediately thought of using questionnaires to collect data* 
about student attitudes towards science. However, they were puzzled about 
measurement criteria since the questionnaire had not yet actually been constnicted. 
Powell suggested that it would probably include questions with a scaled response 
' that ranged from "very interesting" to "very uninteresting." Therefore, some central 
scale point might be set as "minimum acceptable performance." This would be 19 
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subject to change, of course, depending on the actual instrument which the technical 
|oSant wcjfld help construct, but for the moment i; ^uld suffice as a deseed 

'^"'^Sfcause Forms 3B and 3C, on content and contfent seij^^ncing, were so d^ly 
related they decided to deal wtth them together. They Ijad grea diffwulty m 
SrSSiR of poSble data spurces whujh would give them information abo^t th* 
" ll^t and «quence actu^Uy used in^the classroom. A teacher questionnaire wasj 
Ssted buT some membe,. felt that it would „.t be sufficient alone since i 
wo'S only record a teacher's impressions of the cont^t J^u-^^^^^^^ 
used Vic Nolte then suggested that teachers keep a log, at least for a fejy weeks each 
^este r^ey coulfr^cord on a day.to^ay basis what ^nt and sequence 
rrtaiiht S PoweU felt that some kind of check . by an out^de observer 
Lso be hdpful in. order to compare what teachers reported they did with what th^ 
were obsei^ed doing by another person. He suggested that it would be I>ossible to 
leSe an obsenStion checkUst, like one he used in observing the classes of new 
tSrs^He would observe a rancjom sample of classes taught ^ver a penod of 
months and compare his results with those from the Questionnaires^d l^^Sud^^ 
observdtions would be only for content taught, not sequence, smce it Would, be 
dSt wi h a random sample of classes to determine any one teadjer s o^^^^ 
sequence: The teachers felt, hbwever, that such information 
;Shout an opportunity to express the^ reasons for usmg ^f^^l^^^^^^ 
sequences of content. Thus, teacheJ conferences were added to U«5 list of possible 

''^'^Tdements under instructional approach <Form 3D) allowed them moi^ 
freedom and imagination in data sources. For instructional sequence they again 
■ Sst^d teaS^gs and conferences;- but also inchided student v^rk s^p^«. 
S work samples properly dated, would give evidence of tRe order m whi^h 

- ^p'cs were taught to the students. For instructional media, the coordinator 
wo^ d del a materials checklist based on the one included .in the P^f ";^^2en 
Td would personally take a precise inventory of the stocic of l^b 

■ ^ailabk 'Sterns would be - added to the teacher questionnaire regardmg their 
experSnce and impressions of the availabUity of such materiaU. Items yo^d a so 
be added to The teacher and student questionnaires, and to the observation checklist 

. about the extent of instructional activities. u,^ v^tain^d ui/deV 

< Student grouping was the only element the committee had «tai"ed urfder 
program support (Form 3E). For this, the most obvious source of data was the 
exS student records, since they were the original source for such mformation in 
pSslden^ in SCl. physics, or biology. Tl^ese records would provide aptitude 



test scores, reading scores, grade point averages In ^science, and oMier intormatioii. 

The commitjee realized that it was npt practiciil to examine over a tlK)usand studeot 
.records; they instead agreed to sample the ^ecor4s;of each of th^ three science 

groups. , ' • ^ 

Tables would then ^how the averages and relative ranges of aptitudc-and 

acriittemerit scores for the three science groups. This evidence would support or not 

the|ConiitHj4tee members' contention that the SCI students had generally lower levels 
» otability ancKachievemelit than studeftts in the biology arid physics! 

,Walt Powell reviewed tha completed fg^-ms \yith tKe cortt^ittee, and had the 
^'nal copies types, duplicated, and (JisttibKTed.. , ^ ^ ' . 



Tht committec^s completed copies of / / * 
•Forms 3 A through 3E are on pages 32 tq 5^.^ 

Review Part 3 of .these forms*naw befQje 
proceeding the next secUort on putting ^ * 
^ the pl^n ink> operation. ' ; • / 



Putting the Plan into Operation ' • - v 

After having the^ copies lof the forms duplicated^ the coordinator submitted 
them tp the Assistant Superintehdent fo/CurripuUim who reviewed them, suggested 
a few minor changes, and-approved/thbm. 

Powell then soufeht ^mean6%with the technical skills, in evaluation to help hinr 
put the phln into operation. He found an evaluator with appropriate skills who had 
previously done evaluations^ work for the dfstrict, and signed a contract with him for 
consultant services. ^ * * • ♦ ~~ 

Together they ^began to ^onstruCt' insUuniertts " for ^the evaluation. These 
included the teachers' log, the rea\;hers\questli<STOaii^^ the classroom observation 
instrument, the student questionnaire, and the materials checklist. The committee 
' ^members, with the evaluator's help, cWstructed the basic skills test. The evaluator 
also helped devise a procedure fqr drawing a sample of the students' recordftind for 
tallying the data. Tlys^uata collection was'thc first completed by the commiftee, and 
they found a very large difference between the ninth grade SCI students and the 
other science students in both ability and achievement. 



: \ 



During the spring of 1977, instruments were pilot tested. ^^J^'''^^'^^ 
doneTo'be sure that instrucUons for the instruments were clear and that the 
S^mente r« workable. Since this was^ tryout, only a small sample of the 
Sn^s v^e administered the basic skills test and the student Q^est.onnai^. 

mTvaluator and the coordinator together made up. a schedule for 
administering the data gathering instruments in the next school year _ _ 

The evduator also helped to obtain computer processmg fo"" «s"lts of the 
basic d^^s te^t and the student questionn^ The coordinafor had wanted to do 
^hTdttroro^ssi^g on the district's complS service, but the service's programs 

Tot havTthe statistical pKig^ms needed: Hie evaluator had the data analyzed at the 

r:S':S — is m process and is pro^eding on schedule. 
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Case Study - Examples 
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_ These examples arc intended to accompany the narrative portion oT the case 
study ' They have been placed together for easy reference. The set of completed 
fonns constitutes the evaluation plan for the Science Curriculum for Individualiza- 
tion (Sa) in the Belford, Pennsylvania, school district. On some copies of Fonhs 3A 
through 3E, Part 3 has not been completed; these were the program elements which 
the committee dropped as a resutt of its i^qrity rankings in Part 2 for the forms. 
The committee coordinator's ratings are shown in Part 2 of forms 3 A through 3E; 
other committee members could, of course, have given differen,t ratings. 
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PLANNING A PROCRAm tVALUATION 
Form 1 ' Clarifying Conccrm and Qucsliom 



stud ent performance . There, is a concern that "'"'^9rade stud^ts are 
«,t achi^lnrobjectlves of the Science Curriculum for Indlv dual Izat Ion (SCI) 
^cqr^m wU^ respect to basic kno-ledge and skUls. and problem solving 
?n aS3Ttion to coTnitlve outco«es. the program Intends t^roduce Posl^ve 
aUUudes towards science and science study In studenXs^d there Is dPncern 
that many students have negative attitudes towards sciei». 



/ 



Basis for this concern. 



Teachers have reported that many of thel r students seem to be ^^'^^'^ 
ing p^rly on a number of the SCI modules and have poor attitudes " 
ihe J^trlct's Science. Director is also concerned that parents feel that 
I udents are not achieving well in ^-^----''<'^''\^^'^^^^^^ 

last year bygone of the high schools' psychology classes showed sclencft to be 
the least liked subject among ninth graders. 



Possible questions associaled with Ihis concern - 

a. What are the current levels of performance of ninth 9r-de.SCr 
students with respect to the program' s objectives in basic skills 
and problem solving? 

b. What .is the relative performance of these students on these skills 
compared to similar students/round the country? 

c What are current studenpx^ It udes towards science as a school 

subject, as having re^i^N^ance to their lives, and as a career field 
which is open to both males and females? 



I or 111 1 VJfX^^^ 



PLANNING ATROGRAM EVALUATION 
Fonif»l -ChrifywHlConcPTm and Qu^wnJ^ 



\. Concern. 

Student grouping. There is a concern 'regarding the effects of the 
student grouping policy for the ninth grade science program. Under current 
policy, all seventh and eighth grade students take the SCI program. 
HoMever, ninth graiSe students are placed into one of three science programs: 
SCI, b[olo^y, or Introductory physics. This grouping is made on the basis 
of coirt>ined Verbal and numerical subtest scores on the Standard Aptitude 
Test (given in the eighth grade); eighth grade science grad.es; and various 
other factors, -Including student and parent preference. Students with high 
scores and grades go Into either the blofogy, or the physics course. The 
ronalnlng students, about two-thirds of the total number of ninth grade 
st|jdents. are placed Into the SCI progfam. 



'or thn concern. - . 

It would seon logical that students in the biology and physics classes 
are brighter, more highly motivated, and more highly discipl ined .than tt>ose 
students In the ninth grade SCI program.. Removing them from the SCI classes 
Mould leave a group of students of, middle to lower ability, who are less 
not Ivnted^nd less weH disciplined. The proportion of students with 
discipline or study problems would rise in the SCI classes. Informally, ^ 
teachers in the SCI classes report that thi>, in fact, seems to be the case. 
Direct evidence of the exact nature ofUhe differences in the three groups 
'is lacking, however. 



Pojsable questions asiocialcd with this concent. 

a. What is the exact nature of the d i f f erences in ability and achieve- 
ment between the ninth grade SCI, physics, and biology classes? 



^ : 
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PLANNING A PROGRAM EVACUATION) ,{ 
Form I -ChrifyiniConcenaiml Ouertio™ i 



I. Concern. | . \ 

tlon and measurement crucial "^^^.^^''^i'^y K of his or her 
student ~y elect to ^T"' t«chjrs have modified the 
choosing according to his or her !!LVfete at least three 

original progran, to require that ^though the 

::di^rrhe=;"s%rtyi:tJ"e.°rc^ntrnrwith,n a . 

intended to'be taught In a specific sequence. I 
y Bnif for llw concern. 



r 



Teachers. In infonna. -'"""'-•^"::/:rwLrreih"Iht°cr'e^l~ttMn 
teach unit. In a *P«'^i?^ "^"'S.?"* ^te^lhe'rs report omitting so« 

the modules In the specified order. " T j j^e ninth- 

cpntent and adding other content. J"*^*^'^^""" :^ Jell that there 
Trade science teachers are concerned ™^s " d fflcult to 

:aira.oVan"t::i:;t!:iret"^ 



variation. 



Po«ihlequeitteni»i«Hi«««J»iththi. concern. . ^ 

a. What content do teachers actually teach In the ninth grade s"«ff 
classes? 

b. In what order is that content taught? 

c. Why do teachers use a particular content or sequence? 



i 

• ' 
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PLANNING A PROGRAM EVALUATION 
Fonn I - Cbfifirms Comcem and 



1 . Cofiomi. 

Methods and activities . There is a concern as Jio whether teachers and 
students perform essential methods and activities prescribed for the ninth 
grade SCI progr*B. Specific activities and methods are prescribed by the 
pn>9rMi manuals, workbooks, etc. In addition, it is^not known precisely w 
other liicthods are being used by teachers and students and to what extent t 
are being used. 



Bam for tMi conct^. 

The Science Director is concerned about this, partly because teachers 
seem to.be confused as to exactly what methods and activities are to be 
used, and partly because some of the teachers currently using SCI m the 
ninth grade have had little or no formal training in using the program. 
Teachers have.also expressed some uncertainties in using the program. 



ruwililr quettiom asaocktcd with this concern . 

a! To what extent; do students and teachers follow prescribed methods 
and'act.ivities In th^ classroom? 

b. What methods, or activities are omitted or added, and why? 

c. What do teachers see themselves as doing, and what do they actually 
do, as^ seen by an outside observer? 
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PLANNING A PROCR^EVALIIATION 
Fonn 1 - Cbrifyinj cJticctI&v' 0««»o» 



L Concern. 

Hateria ls and facilities . There Is a concern about the avallabl U ty of 
materials and facilities needed to teach thfc SCl properly. The SCI program 
was developed by a research center at a southern university and has • »«J9. 
well-defined list of laboratory materials which are intended to be used n 
t:lching the cogent of the program. Certain facll Ities are a so specl ed • 
or ImpUed such as gas jets for lab work or window for "^^ »~ f^^^ . 
ments The SCI program also has a series of consumable student workbooks In 
3^ich' students work^certain problems and record data from experiments and 
demonstrations. 



for thii concern. 



Teachers have complained aV various times about a °f >j 

materials and facilities. Workbooks are °f'«",7' » lon^ fT^UHiJ 

equipment is in either short supply or not available at »' ' . ' 
a?e ^n not to be available. It is not knc«n "'"'^3 %;^*^^^"^f ^^e 
teachers have encountered such shortages, or exact^jj, what the extent or 
shortages are. 



3, PoMiUe question aMociited with thii concern. 

.a. Precisely to what extent are materials and facilities available or 
not aval labl e? 



b. 
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PLANNING A niOGRAM EVAlUATtON 
. FotB 2 • SMBumifli Buk Profiam Infonmlion 



PLANNING A PROGRAM EVALUATION 
fom 2 • Summiriang Bisit Program Wonmtion (Continued i- 



l-Uenlification 

I. Propmtitk. ; 

Science Curriculum for Individualization (SCI 

I Content. 



Part 3 'Students 



Loations at which prognm is uied. 



Ninth grade SCI 'is taught, at'only one location, North Junior High School, 
Ellis Drive, .Belford, Pennsylvania. This sch^l contain* only ninth 
grade students. [ 



I 



The program presents a series of science topics (e.g^^incasurc- 
Bient, the environment, the universe^ biology,' etc.) for seventh, eighth, 
and ninth grades, (inly the.nlhth grade program is the subject of this 
evalvation, however. 

3. Sourcetmdicferencaontli^pnvini. 

Student text booklets: The Environrient , The UniVer^ , Heasurement , Biolog- ^.^ ^.i. «r««in 

• Ual Science , Force and ftotlon , and Phy si^ITkiS^ ^ ^ Student popuhtwn «omted with prog^^ 

' Student workbooks to accompany each of the six text booklets. These workbooks 

are consumable and are not reused. 

Teachers Hanual which gives more information on how to teach specific points, 
do demonstrations and experimeffts, etc, 
(Ibjectlves Ust listing all objectives for the entire SCI program 
Hater la U List listing all riaterials needed for demonstration and 

• experiments 



Ninth grade students are placed in one of three science courses: physics, 
biology, or SCI. Following is a breakdown of the enrollments in the^se 
courses; . ' *' 



Part 2- Personnel 

4 Program Director, 

Walt Powell, Science Director, Belford Public Schools, PA 

5, Siaffmg, 

The staff who currently teach the ninth grade SCI program are: 
Ira Dayton 

Joan Cohen ^ " \ ' 

Bill Ari^strqng 

VicHoltc 

Les Fisher 

Ed Tompkins 

Gloria Cummings 

The first five teachers listed teach ninth grade SCI classes only. 

The last two, teachers are full-tif^e teachers bjt teach ot^er science courses 

for. part of theic time. [ . 





Boys 


Girls 


Total 


SCI 


377 


326 


703 


Biology ' 


103 ■ 


111) 


217 


Physics 


87 


.76 


163 


Total 


567 


516 


1083 



Approximately 65tof the students at North Junior High School are white, 
15? black, and lOi of Spanish speaking backgrounds. 

Belford is a small older town, that has now become a somewhat removed • 
suburb of a large urban cit?^ It Includes a central town area, originally 
of Civil War era and now somewhat run down; better quality suburban homes, 
and large areas of farmland. In recent years, there has been a large 
influx of blacks and Spanlsh-spcaking families. 
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PLANNWC A PROGRAM EVALUATION 
Foiii3A-SCiiaBit Outcomes 



Piitl-Ckifw Intended StudcTil^^^ ^ 
li Type ol otttcow. Check one and coropleteH^ ^ 

DL Attitudes 
D F: Values 

D G. Personal development 



□ A. Information ftciU 
B B. Bttc siciDs 

□ C Hifher order processes 

□ D. SupportdciDi 



lb/S|NCifially<ittxleB4 



□ H. Social development 
/ 



Be'able to perforin basic scientific operations. 



PLANNING A PROGRAM EVALUATION \ 
Form 3A • Student Outcomes iContinuedl 



Part 3 • Gatherini and ilsin^ Evidence 
4. SouiceofdiU, Wtat source of diu will ph)vide evidence about this outcow^ 

There will be two sources of data for tlHs perfomance... 

a. Standard Science Achievement Test (Quantitative Skills Sobtest). 

b. Locally constructed achievement test (Heasurement and Observatlfln 

Subtest]. 



5. Measurement qtoioo. 
student? 



What is the minimum accepttble performance Jor an individual 



a. Student scores at oi^ above 50th percentile of the SSAT-duantitatlve 
Skills Subtest.' 

b. Student scores BOVof ittffs correct on Heasurement and Observation 
Subtest. 



2. Studentbehaviois. What arc some represenuiivc behaviors for this type of outcome^ 

a. Make accurate measurements with appropriate scales. 

b. Hake obJAtive observations. 

c. Make accurate records/descriptions of these observations. 

d. Analyze and interpret quantitative data. 

e. Organize a data collection procedure. 



h. Sipdenuexpectedlomeetsundard. How many students in^ our piptttbn are e^^ 

meet this standard? 

a. At least half (352 students) should achieve scores at or above the 
50th percentile on the SSAT-Qgantltatlve Skills Subtest. 

b. At least threrfourths (527 student*) should get 80t of the Itens 
correct on the locally constructedKeasurement and Observation Subtest. 



Part 2 ■ Setting Prionlies for Further PtannA 
\\ Relative priority. Compared wiih other types of outcomes and sludcnl behaviors lhal might be 
examined, \^ highly related is this to our concerns a(\d questions'^ 



Use a rating salt of 1 to 5 with 
5 = vcr> highly related and 
I = only a little related . . 



5 



Write the number 
inlhisbo\ 



32 

FRIC 



Popubtion chifictenitics. What chancteristics of tim population ait useful to know in 
interpreting their performance? ' 

Avcraje to below average range of ability and achievement. Most high • 
achieving students are In biology or beginning physics In the ninth grlBe. 
One-Wtl) of students In this course are of Spanish-speaking background. 
Remainder are of mostly white, middle-Income families, some blue-collar, 
some farming, some white-collar families* 



# 
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PLANNING APROCRAM EVALUATION 
FonB3A*S(iideAt Outcome, 



Part 1 -Ckiiyini Intended Student Outcomes 



la. Type^oatONK. (M one and complete Itein lb. 

.* 

D A. hforqitionitciil 
DB. Bascdnib 
' B C K^ttrordcT^ocesscs 
, D D. Support skills 



a E. Attitudes 
Df Values 

D G. 'Personal development 
□ H. Social devclopmcnl 



fLANNWC A PROGRAM EVALUATION 
Form 3 A '* Student Ouloomes (Continued ) 



Part 3 -Gadicnni and 4ing Evidence • 
4. Source of diti. What source of dili will provide evidence about this outcome? . 

Standard Science Achlevcwnt Test (Problen Solving Subtest). 



lb. SpedfkaOy.itodentidioBld. 

Be able to solve sciefce probleis using |L(|*^Wlfic operations. 



5. Meisurwtnt crilerion. What is the minimum 'accepuble'perfonnance for an indi^^ 
student? 

Student scores at or abov/ the 50th percentile, 



2. Stndem behivion. What arc some Tcpresentativc behaviors for this type of outcome? 

. " > '' 

a. Solve word problenis involving measurement, observation, data analysis 
' . aid interpretation, and organization of daft collection procedures, 
b* Use" scientific procedures to solve probl^jji^rejated to practical 
' incidents they might encounter in their everyday life. 



(1, Students expected to meet rtiidifd. How many students in our population are expected to 

meet this standard? ' < 

At least half (352 students)* should achieve scores at or *bove the 50lh 
perWfitile* 



Part 1 • Sdling Priorities for Further Plannmg 

3, Rebtive priority. Compared with other types of out comes jnd ^tudt'nt behaviors that nindil be 
examined, how highly rcljled is this in our concerns and questions'' 



5 



Usi'iirahnifstalcof ItAS^^ith 

5 = very highly reWcd and 

i^onlyaliltlerelakJ Write the number . 



) (his box 



lorm.l'\:pagelof I 



r Population chancteristici. What charicteiiitics of this population are useful to know 
■ intcrprcling their performance? ^ 

Teachers report eviderice from their classroom observations that many ' 
students cannot solve problems readily, either word .problems or practical 
problems, 
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PLANNING A PROGRAM EVALUATION 
ronn3A- Student Outcome! 



Part l-.Ctirifying Intended Student Outcomes ^ ^ 

I,; lypeofoateone.Checkoiieandcoitipleteltemlb. 

□ E. Altitudes ^ 



Q B. Buiciilli 
DC/Hi|hcroi4etptoce8!0 

B D. Support skOls 



0 F. .Values 

D ;G, Personal development 
D ll, Social development ■ 



lb. SpedllciIly.tliidentjADuld-, 

Conduct; th«$«lves properly In lab sesslins. 



PLANNING A PROGRAM EVALUATION 
Fonn 3A -Sliident.Oulcome! (Continued) . 




■ Part 3 -Gathering and UsiTig Evidence 
4, SouweofdaU. What «ke of data will provide evidence about this outcon«? 



/ 



Student? / 



2, Stirfentbduvi.„. What are some represental^l^ha^ors' for this type of outcome' 



a, Will use lab science equipment properly, 
b! Wll^foliow safety and discipline rules, 



6. Students expected 
meet thisstandiid? 



,onwtit.ndirf.HowmanykudentiinourpopuUtionaieexpectedto 



■ ■ Part 2 -Selling Enoritics for Further Planning . , 



I 

Use J rating scale of l!o5wi(h 
5 = very highly wlated and 
I = only a little related . . 



Write the number 
ihtbisbor 



ERIC 



Form 3A: page 1 of; 



interpreting their performance? 

f , ■ Hi 



FormJA; t?P-of- 



PLANNING A PROGRAM EVALUATION 
Font! 3A-SliKknl Outcomes ' 



' Parti -Clarifying Intended Sludcnl Outcomes 

la, 1>pe of oulcdmc. ChecK^i^c and complete item 1 b. 



^ □ A. Informalion/rccall 

□ B, Basic skills 

'DC. Higher order processes 

□ D. Support skills ' 



B E. . Attitudes 
D F. Values J 
□ G. Personal development 
D H. Social development. 



lb. Specificilly,itttdenl!shottH... ^ 
'.Have a posltlve'attltude^ towards the study of science. 



? 



PLANNING A PROGRAM EVALUATION 
Fom 3A ■ Studenl Oulcomej (Continued) 



Part 3 -Gathering and Using Evidence 
Source of data. What source of data will provide evidence about this outcome? 
Student Attitude Questionnaire (to be constructed). 



Measurement critfriort. What is the minimum acceptable performance for an individual 
student? 

a. Student ratV^clence as "interesting'' on a scaled questionnaire Itern. 

b. Student rates science as "relevant" on a scaled questionnaire Item. 

c. Student shows no sex bias In response to Item regarding males and . 
females choosing car^s In science, 



2. Student behiviors. Wliat are some representative behaviora for this type of outcome'' 
^ *^ 

a; Find the study of* lence interesting. 

b. Feel tl\jt science is relevant to society and their dally lives. 

c. Feel that science offers careers at which both male* and females cin 
^succeed. 



6. Students expeeled 10 met! standud. How many slidenlunouf population arc expected lo 
meet this standard? 

a. All students should ratefclence as "Interesting" or better. 

b. All students should rate science as "relevant" or better, 

c. " All students should display no.sw bias regarding science careers , 

for males and females. 



' Part 2 - Setting Priorities; for Further Planning 
' Relative priinty . Compared with olhei types of out a^mcs dnd student bchavioni that might be 



examined. W highly^rclatcd is this to our concerns and qircstions' 

■ ■ / ■ . \ 

Usearatingscalc;ofilt)5with • 
5 = vcr> hiihly^related and 
I = only a little related' 



Wriic the number 
in this hox 



lorni3A:pii{t^lol'; 



7: Populaliun chincteriitics. What Characteristics of this' population are useful to^now in 
interpreting their performance? 

'hany students seem to have poor attitudes towards science or are at^least 
Indifferent to It. Both boys and girls seem to regard science as a male 
field, 
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PIJWWINCAPROCRAM EVALUATION 
Fonn3B*Curriculuin Content 



PLANNINCAPROCRAM EVALUATION 
Fofni3B-eunfculuw Content (Continued) 




hrt I • Oirifyini Intended Cumculiun Content 
li. Source of content, Check one ind complete Item lb. 

g A. TnditioniUcidemic disciplines' 

D B. Penonilcxpericncd of students 

^ DC Society IS an environment 

D D. The world of thoujht 

Sed thit the pre«n. oiiriculun, vmr^ mfUm'. (S« App«id.x M for so.c 
possibilities within each irei.) 

2. Facts 

3* Key concepts 

Rules and relationships 
5, Methods and procedures 



Pift 2 ' Settini Priorities for Further Planninj 
Rclative^riority. Compirtd^th other element, that naBhll.;unnned.»K^M^^^ 
is this to^ concemi ind queitioiu? 

Ujetritiniwleof ItoSwith 

5xveryhi*lyitl»t«l»n(l Write the number 

h only » little related.' .^^^^^^ 



0 



Pirt 3 -GitherinittdWni Evidence 
4 So-«,fd.t. Wh.t«^ofd.Uwi«;»ovid.etoilK.t«hetl«rthe«ty,«of 
content are ictuiBy emphuized in the pftwt proinm. 

'leieher duestfonnalre ■ Teachers report what typ«i of content thiy^ 

b. SJlX - Teachers «intaln a log, of types' of cont«,t actually 

c. £«tron Checkl 1st, • Science pireetor observes and^reports on 
content actually taught In random sample o^'"'** •„ 

d. Teacher conferences to discuss sources and types of content actually 

taught. 



Reason. Why should these types of content be emphasized? 

Skills In science require that content be emphasized whicli teaches basic 
scientific facts; key scientific concepts by which those facts are 
explained and.organlzed; the rules and relationships among concepts; and^^ 
the methods and procedures which are included in tlie_"5cientiflc method." 



I 



list of concerns and questions? 

All teachers should give primary ea^hasis to these types ofcontjnt as 
de^x^strated by (l) time devot«l to th.«. and (^^'''1?^ Tf er nces 
them. Teachers will be further asked to Interpret -'J^/^^^^ 
in time devoted to each of these types of content, and what content tney 
feel should be' emphasized, In a teacher.eonferencft. 



PLANNING A PROGRAM EVALI/ATION 
Fonn 3B*CumculuniCoB!erii 



■Part I : Qmfyini Inlcndcd Curriculuni Content 
la. Source of conlenl Check ow and complete Item lb, 

□ A. Traditional academic disciplines 

B B. Ptrsonal experiences of students 

Of. Society a$ an environment 

0 D. The world of thoujjit 

lb, Typn of content. More ipecificilly. within this subject matter area, what typcu^f content is 
' it inlcndcd that the present cuiriculum program emphasize^ (Sec Appendix H for some 
possibilities within eich area,) 

Student Interest! or purposes. ' !■ 



PLANNING A PROGRAM EVALUATION 
Form 3B • Curriculum Content (Contintiedl 



^ Part 2 • Setting Priorities for Further Planning * 

Relative priority. Compared with other elcmcnis that might be examined.how highljf related 
is this to our concerns and flucstions? 

Use a rating scale of I to 5 with 
5 = very highly related and 
I - only a little rebted 



0 



Write the number 
in thi$ box 



Part 3 ' Gathering and Using Evidence 

Sources of data. What sources of data will provide evidertce^aboul whether these types of 
content are actually emphasized in the present program? 

a. TMther Quejtlonnilre • Teach'irs report to what extent content chosen 
WIS based on expressed student Interests, and what methods are used 
to stimulate student interest. 

b Teacher L09 ■ Teachers melntaln log of types of content ictually 
taught and to whit extent It was based on expressed student Interests. 

c, Observation Chwkllst - Sclince Director observes and reports on wntent 
■actually taught In random sample of classes. 

d. Teacher conferences to discuss sources and types of content actually 
> taught. ' . 



:. Reisons, Why should these types of content be emphasized'' 

It Is Important to develop positive student attitudes about science, By 
encouraging students to pursue their' own Interests within the curriculum 
progrim, students may have a rore positive attitudei^ards the stu y of 
science and be able to relate It more to their owrt'Ti^et and potential 



careers. 



ERIC 




V Judgment aileria. How will the data collected be judged or interpreted with respect to our 

list ofconccrns and questions? 

All teachers stoufd give strong emphasis to stiwiating Interest in science 
and to using these Interests to Improve student attitudes towirds science. 
This could be denonstrated (1) the Mays In which teachers stimulate 
Interest, and (2) the extent to which such interests Influence choice of 
content. Teachers will be aslced In conference discussions to interpret 
reasons for differences In their approach, how,tp,stlmulate Interest, and 
the extent to which such Interests sl»uld and does- Influence content; 



choice. 



. Forn,5B'pa,e^f^l^53^;^ 



rUNNlNGAPROCRAM EVALUATION 
Fonn3C- Content Scquencini 



PLANNING A PROGRAM EVALUATION 
FonttJC • Content Seqiiendni (tontinoed) 



hrl I .Oirifyini Intended Conttnl Sequencing 



U TVpebf corrtcnt (from Itetl lb on Fonii 3B), 

. on< and compkte Hemic. 

. 0 A. Experience or obicrvation of the worid ' 

• « B. loficilitwcturc of exiiting knowledge ^ 

□ C Methods of InteDectuilinquiiy 

Q D, Astumptiom ibout the psychology of leaming 

D E. Cbwlitionsunderwhichknowlcdgccouldbeuscd. 

1. CMmtmmi^V^^ Mottspecificallyjorthistypeofcontcntandfort^^^^^^^^^ 
Appendix M for lome powbUitiei within each souree.) 



Part 2 ■ Setting Prioritiej for Further Planning 

Rdilivepriorily.. Coraparvd with other dements lhatn)ighl be cxami^ 
is this to our concerns «nd qyestions? 



Use a rating scale of Ito 5 with 
5 = very highly related and 
I ''only a little related 



0 



Write the number v 
inlhisbox 



^ Part 3 - Gathering and Using Evidence 

Sources of daU. What sources of data will prgvide evidence about whether these content 
sequencing principles are actuaUy emphasized in the present program? 

Teacher conferences to discuss types of content and sequence In wMch 
content Is presented. 



k. Concrete to abstract 



2. 'Rewm Why ihouldllieM principles be eniphasiied? 



Scientific facts en be Illustrated by ncving '^o;;;'';;;;;;''''' 
from a student's experience to more abstract facts which can not be 
so easily Illustrated. 



5. Judiment oiteiii. How will the data collected be judged or interpreted with 
list ofconceras and questions? 




to our 



T6achers,.ln the conference discussion, wlll.dlscuss these exmp «, 
provide further data on their actual practices, and the rw'ons for 
these practices, interpretations will be «.de at that t\m re^i ng 
whether the preientatlon of facts In the science course la, f he 
TOSt part, iMde In t^ls way, and what alternative methods mljht be 
used. 



ERIC 
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PLANNING A PROGRAM EVALUATION 
Fotin3C' Content Sequenpini 



: , hrt I • a»rifyini Intended Content Sequencing 

la. ' Type of content (from Item lb on Form 3B). % 
Key concepts 

lb, Sourceofcontentieqneiwniprinciples, llw intended source for this type of content. Check 
one ind complete Item Ic. 

□ A, Experience or observation of the worW 
BB. Logical rtructurt of existing knowledge 
DC. Methods of inteliectuai inquiry 

□ D. Asiumptions about the psychology of learning 

□ E. Conditions under which knowledge could be used. 

Ic Content lequendni principta. More specificallyjor this type of content and for this sou^^^^^ 
what sequencing principles is H intended thai Ihc present curriculum program emphasize (See 
Appendix B-2 for some possibilities within each source.) 

7. Prcrcquisitcorder of concepts 



PLANNING A PROGRAM EVALUATION 
Form 3C ' ContenI Seguencing (Continuedl 



Fart 2 • Setting Priorities forTurther Planning 

Relative priority/ Compared with other elements that might be examined, how highly related 
is this lo our concerns and questions? f 



Uscaralingscaleof Itoi with 
5 = very highly related anil 
1 3 only a little related.... 



0 



Write the number 
in this box 



i 



4- 



Part 3 ■ Gathering ind Using Evidence 
4. Sources of ^iti. What wurccs of data will provide ^jidence about whether these w^^^ 
sequencing principles are actuaOy emphisired in the present program? 

Teacher conferences to discuss types of content and sequence In which 
content is presented. 



.JReions. Why should these principles he cn\phasi2cd? 
" ; if 

Mastery of scientific knowledge Involves a hierarchy of interrelated 
learning objectiws, Certain concepts In science are prerequisite to 
tht learning of other concepts. 



5. Judgment criterii. How wilj the data collected be judged or interpreted with respect to eur 

list of concerns and questions? - 

Teachers, In the conference discussions, will discuss ways In which 
they sequence this* type of content, provide further data on their 
actual practices, and the reasons for these (kactlces. Interpretation 
will be made at that tlnie, regarding whether the presentation of 
key concepts in the science course Is, for the most part, made ' 
in this way, and what alternative methods might be used,. 



I (inn K pagi- 1 of. 
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PLANNING AFROCRAM EVALUATION 
» Form 3C- Content Sequencing 



f 



PLANNING APRpCRAM EVALUATION 
Form JC- Content S^Afncim (Continued) 



tSycinil 



Pirt 1 •Quifyini Intended Content Sequencing 
li. Typtofcortent (froinltemlbonFomi3B). 

Rules ind reUtlo«»hlp» .... , . n..^ 

lb;So««of»«te.t«v«dn,pd«ci^ Theintended«.urceforth.,typeofcon,ent.Check 

oneind complete Item 1c. 

» 

DA. Experience or observition of the worid 
SB. LogicJi structure of existing Icnowledge 
I ' ac. Methods of intellectual inquiry 

DD. Asjumptioitftbout the psychology of learning 
' 0 E. Conditions under which linowledge could be used. 
Ic Content seqOBKlBi'principlei. More specificJlyJw this type of content and for this »urc^ 
, Appendix B-2 for some possibilities within each source.) 
6. Kule to application of rule 



Part 2 ■ Setting Priorities for Further Planning 

3. Relative priority, Compared with other elements that might be examin.|i. how h«hly feUted 
is this to our concerns and questions? ' 



Use a rating sole of 116 5 with 
S« very highly rclatc^ lnd 
,1= only a Uttle related.... 



0 



Write the number 
in this box 



Part 3 • Gathering and Uring Evidence 

4 Source* of diU. What aourwi of diU will prowde eviden^^^ 
sequencing pfindpte are actually emphiilwd in the pit«^^ 

Tftacher wrferences to discuss types of content and sequence In which 
content Is presented.^ » 



content 



Reasons. Why should these principles be emphasized? 

Rules are traditionally taught before the application of rules. 



5. JwlgmentaHeria.' How wiB the data collect;d be judged or interpreted with reaped to our 

list ofconcems and questions? * ^, . ' 

Teachers, In the conference dljcusslon; will discuss ways In which 
■ they sequence this type of aJntent, provide further data on their ■ 
actual practices, and tha reasons for these practices. iMerpratatlon 
will be made at that tlma, regardlnj whethir the presentitlon of , 
rules aod«latlonshlp5 In the science course Is, for the most part, 
made In this way, and what alternative methods might be used. 



] 
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Form X:; par I of ^ 



FLANNING A PROGRAM EVALUATION 
Fqnn3C-ContenlS«qiiencing 



■ \ 



' * ' PLANNING A PROGlUMEVALpON ^ ' 
Fornf JQ- Contnt SqueiMng (Contmued) 



^ pjrt I - barifying Intended Content Sequencing . . 

la. Tifeofconlent (fromltemlbonForm36), . / 

Hetfiods and prrfccdurcs > ; , * . .. . ^ 

lb. SourceofconleJtiequencmip^ • TTicinterkled source for this type of,^^^^^^ 
one and complelc Hera Ic. ■ ' ' . , ^ 

D A. Experience or observation of the world ^ / 

D B, Logical structure of existing knowledge * ' • ' 

DC Methods of inteiiectualinquiry 

' B a Assumptions about the psychology of learning ^ 

D E. Conditions under which knowledge could be used. 

I 

Ic. Conlcnl seqfiencing principles. More specifically, for this lyp« of content and for this source, 
what sequencing principles is i\ intended that the present cumculum program emphasize. (Sec 
Appendix 8-2 for some possibilit|s witiii^ 

1. ^Prcrtqulsltc order of^ikMIs , ^ 



4i ^ Part 2 • Settii^Piioritics fofrufther Pllnning, ^ ^ - . 



3. Rdajivc priority. • Compared with other clj^nls that mi|hl be wwiinijl, how highly related . 
is this to our concerns and questions? ^ / ^ ♦ 

v.- ■ <; ; . . • * -s 

''UscaratingscaleofltoSwlh J * '.^ ' ' jtl • 

S = verylriihlyrebtcdand/^^:V ^ ' 4 ? 'L ' i ^l 



l=:ojilyalittlerelaltd..,,..'.-..':.^). 



Write the number , , ' / * 
\,inthisb<yx _ / .; 



4' 



• Gathering iftd I|in| Evidence ^ /■ t 

4, Sourca of di(i 'What sources of^datartl provide evfdence about whethei Ihcseicontcnt ^ 
scquencini principles are actually eniphasizcd in the present program? , , , ^ t 

Teachef' conferences to dIsWss types of cWcnt and sequence Jn ' i-' 
■ which content Js presented, ' ■ , # 



if ^ 



i 



r 



I Reasons. Why should these principles be cniphasized? 



Mastery of the'process known as the "scientific method" Involves a 
hierarchy of learning objectives. , Certain skilU In using the sclt^ntjflq 
method are 4)rerequ! site to the learning of. other skills. ■ ■ 



5. Judjmenlcrileffc. How will the data coDedcd be judged or interpreted with respect to our^ 
„ list of concerns and qucstioijs? ^ * 

Teachers, In the conference lltusslon, will *dl5CU5S v«/s In which 
• they sequence this ty|Hj| of 'content, provide further data on their ■actuajt 
. practice's, and the reasons for these pr^cti,c?s. Interpretations 
will be jjjatle'at that time, regaj-dUg whether the presentitten of methods-, 
and procedures In the science course. Is for the most part, iwde in 
this way, and what alternative methods might be used. 



■ f 
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rUNNWCAPROCRAM EVALUATION 
FoimSC-CoDtentSeqoeiKint 



PllANNWiAPROGRAM EVALUATION 
Fom ic • Conlnil Sequendnj (Continued) 



• Plrtl-djiifying Intended ConteA Sequencing 
•|i Type of coBlcnt (from Uem Ibon Form 38) 

Student Interests or purposes v 
■ li i^^f^^nV^V^ The«»urceforlhisty^ofcontent.Ched 
one ind complete Item I c. 

V . Q X. Experience or objemtion of the wortd " ; 

/ i □ B; Lofieil structure of exiitingloiowledgt 

4c. Methods of intellectual inquiry 
: '; . "B d; AsJUBiptionssboutthepsychotogyofleaming ■ 

t».- tif.. Conditions under which knowledge could be used. 

1- f.«.«,t6a;iencin«Piinciplei. More specificailyjor this type of conlert and for this source . 
^ ^XS^n^^ilinteJthatthepr.^ 
Appendix B-2 for some pouibilities within each source.) 

- I|. More Interesting to less interesting 



Part 2 • Setting Priorities for Further PUnnini 
3. RAlkprtofity. ,Compar^withotherelen«nt,thatnu,htbee«nrinid.howh^re^^^ 



is this lo our conccmi ind queitions? 
Ujcaratiril^caleW I toSwith ^ 
l=onlyatitllcftlatcd 



■ B 

Write the number 
inthishox 



Pirt3-Gitt»ctingindUfingEvidence 
4' So««.ofd«t. Whst source, of det. will provide ddence .bout whether these «n^^^^^ 
■ «quencingprindpbaread,uallyemph»siiedintbepreientpro|rM 

Teacher conferences to discuss' sources and types of content and 
sequence in which content is presented. 

. 'I * ' 

I 



2. Reijoni. Why should these principles bt emphasized? 



By eraphaslilng content which possesses greater interest for students 
or TOi-e relevance for their purposes should help to overcome student . 
Indifference and foster positive attitudes toward the study of science. 
By lettlns students study more Interesting topic areas first, it may 
be possible to generate interest in other topic areas, 



■judp^nl dteri.. How wUl the d.U collected I. judged or interpreted w^fespee. tabur 
lijtofconceiTO and questions? 

Teachers, In tiTe conference discussion, will discuss ways In which ♦ 
they utilize student Interest and. purposes In sequencing content 
and Its use as a source of content. Interpretations will be imoe 
at that time, regarding whether student Interests and purposes are 
utillied, to what extent teachers feel they should be uti Ized, . 
and what alternative wthods of Involving students might be used. 




r 
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PLANNING A PROGRAM EVALUATION 
Ironn 3D ' Imtniciionil Approach 



Piit I *6ihfying Intended Inslmctional Approach 
la. 'iDilnictiooilipprotdi Check oneand complete Item lb, 



D'A, Learning objcctivw 

D B. Assessment of learning needs 
d C, Diagnosis ofleifning needs 

D D. Placement ' 

B E. Student motivation 

□ F. Instructional sequence 

aC. Pacing. - 



□ H. Instructiona! methods 

□ 1. Instructional settings 

□ J. Instructional medi^ 

D K, PrimJw roles of student 

D L PrimaiVroles of teacher 

D M. Instructiinal activities 

D N. Pftrfon/nce evaluation 



lb, Spedft: imtructionil stntegiei More specifically, within this instructional approach, what 
strategics is it Intended thai the present curriculum program emphasize? (See Appendix B-3 for 
some possibilities within each approach.) 



PLANNING A PRXR AM EVALUATKW 
Fonn 3D - Inftioctional Approach (Copiued) 



Part 2 • Setting Priorities for Furtberflannmg 

3. ' Relative prbrhy. Compared withothjf elements tttit might be examined, how highly related 
is this to oui concerns and questions? ' 



Use a rating scale of 1 to S with 
5- very hi^ly related and 
l = onlyaUttle related,... 



0 



.Write the number 
in this box 



Part 3 - Ga||iering and Using Evidence 

4. Sources of data. What sources of data will provide evidence about whether these 
instructional strategies are actually emphasized in the present pro^? 



3. Based on student's Interests 

8. Based on Increased student freedom of choice 



1 Reasons. Why should thcsclnstructional strategics be emphasized? 

Students are more likely to vant to learn when instruction taps their 
existing interests. $tudentJ|re also niore likely to want to learn 
when they have soine freedom ^holce In what they, study and thus are 
more able to control their learning environment In order to pursue 
. content which fits their Interests and purposes. 



V 

5. Judgment ffhertt. How wiU the data collecled by judfcd or interpreted with respect to oiir* 

list of concerns and questions? I 



PUNNBWAPROGRAMEVALWTIW:-^^^ 
Fonn3D-liiitnictionil Ap^j j; ; ' 

' ' « . r '"r r 



• ♦ . Pitt I -CUrifyini Intended Instnictional Appfwch V •; ; . , ; • 
la. WrudkmiltW^ 



□ A. Lnrniflsbbjcctivcs. 

D B. Asmmentaf lcarniniheedi 
QC. Diifww of Icaming needs 
D D. FUcement 
DE. Student mQtivation 
BF. Imtructioqal sequence 

♦ 

□ G. Vacint. 



;Q M/ZlijaiifuctW 



■r id..tMi« More »ert'«tM« this injimcum^ 

lb. Specific iMttwtionil rtntepei More ''.'" J'^^rkflveMDhifiif? (See Appendix B-3 for 
Segiesijitintended tlut the pie$entcurnc!au.in)»s4ra^^^ 

some poaibilitiej within eichipproach.) ; 

1. Objectives: Fixed, sequence ' 'l^-^ /' ■■ 

2. Objectives: Flexible sequenct,V . :, --;v i' *■ ■ ■ .,■ 
Cyrriculiffl content: Fixed s^qufenfi^^^'.v.-;; r.'.'; ; 

5. Curriculum content; Flexible'Sf^h" ; /• ./ ; ^ 

7 Instructional ktWlties; FiJtfe() s^<i)Jjqte;, , 

8 Instructional activities: .FWlJe;5p9«enf^, \ 



PUSNNINC A PROGRAM EVALUATION 
Form 3D - laHuctionil Ap|w>ch (Con tinuedl 

Part 2 - Setting Priorities for Further Planning 
ReUtive priority. Compared with other elen«nt.tha,n«ght be examined, how h^lyreUted 
is this to our concerns and questions? 



Use a rating scale of I to 5 with 
5 = very highly related and 
I = only a little related..,. 



0 



* Write the number 
inttusbox 



hrt 3 -Gathering and Using Evidence 

4 source, of daU. What so^ of data will p«.vide evxle„« about whetl^r these 
' Sist«teg«.reactdlyen.ph»»dbtheF«nt,^^ 

a Teacher Jog ■ Objectives, and currlculun content actually taught and 

,/,;rtrsr:iis"tr^^s-pie^^ 

fdr using them. 



1 Rei««i Why should these,instruitip^^^^^^^ V . 

This curclculo. <Jrfers a WiM^tpn^P^bJtV&d^ 

In objec Ives, content, an'd itrttructloaal- act vhles. It % ■ 

ill Leli and objectives, 'conttet ,'afld: actlvUTes are f xed with ^ . , 

opSlo.'a/ selecting the ord^f. In' which take the., arid thus so| f lexl 

j»iiit/u>nvin. • ■ :^3-:;V^';;C:^r'':'. : f :1 

' ThW'flWfllity will. permit: sttKlentVW:^^^^^ ■ ? . 

' t S tivltlesof tt»^I>s»:aM^^s^^ 't), «^ • 

/ ;. Srrinsure that speclf|id^0nj|.^'*iri;be^« in a specified . 

■ ■ordw.. i^-'':'.'^ ^' 



,^inent ajteria, How wiU the data coHecied-by judged or interpreted whh res^foour 

is being used, or th.t • fl^lbl* »2:;rJ , 
M An a ««)dule. In discussions f «c «r . W will 
^^MUt possible Interpretations or different practices, 
■and IC*tlons.for changing Instruction. 



PLANNING^AnOGRAM EVALUATION 
Form3D-l«MioitfA|Tro^ 



hrt I -narifying ln(ende<Mifitructional Approach 
la. ImtnKtxNttlippmdL Chtiioiteand complete Item lb. 



□ A. Leamini objectives 

□ B. Assessment of learning needs 
DC Diagnosis of teaniint needs 

□ D. Placement . 

□ L Student motivation 

□ R instructional sequence 

□ G. Pacing, 



a H, Instructional methods 

0 I. Instructional settings 

□ J. Instructional media ^ 

D t Primary roles of student 

□ L Primary roles of teacher 

□ M. Instructional activities 

□ N. PeiJ^ajice evaluation 



lb. Specific instnjctional stntepei. More specifically, within this instructional approach, whSt 
strategic is it intended that the present cu^culum program emphaazc'? (Sec Appendix B-3 for 
some possibilities within each approach.) 

3, Lecture (pccscntat Ion by teacher) 

l|, Denonstratlon • ' If 

$. Explanation 

6. Question and answer /' - * 

7. Discussion 

11. Direct experience 



PLANNING A PROGRAM EVALUATION 
Form 3D - imtmctionil Approach (Continued) 



Part 2 • Setting Priorities for Further Planning 

Rejitive priority. Compared with other elements that might be examined, how highly related 
is this to our concerns and questions? ■ - 



Use a rating scale of I to 5 with 
5 = very highly related and 
I = only a little related...* 



0 



Write the number 
in this box 







brt 3 - Gathering and Using Evidence 



Sources of daU. What sources of ' data will provide evidence about whether" th^e 
instructional strategics are actually emphasiied iii the present program? 

a. Teacher questionnaires - Teachers rate frequency of use of each method 
plus other methods used* 

b. Observation of classes - Science supervl^r nakes random sample of 
classes tcr determine frequency of use of methods by actual observation 
checklist, 

c. Teacher conference - Teachers discuss frequency of use and reasons 
for use. 



♦ 



Reasons. Why should these instryclional strategics be emphasized'' 

Instructional methods for this program are carefully prescribed in the V 
manuals and handbooks for. this program as well as' In the.training jcsslons'.. 
for teachers. This particular set of methods Is intended to serve the 
functions of glvinjl Information to students (as in lecture, question and 
answer/ and explanation), and Involving students more directly In the 
teacher-learning process and reinforcing learning by practical expelrlence • 
(as l^n demonstration, discussion, and direct experience). Others are 
used 'to sow extent, but these are the primary methods. « 



5. . Judgment criterii, How will the data collected by judgpd or interprets with respect to our 

list of concerns and questions? ^ . . 

Teachers should, by the standards of the original program, be using these 
instructional methods primarily- Frequency of use and hw these methods 
are used will be c6mpared with an estimate of the actual frequexy of use 
(made from the observations) and differences between these, and possible 
-/.reasons for these differences will be discussed at teacher conferences. 
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FUNNING A PROGRAM EVALUATION 
FmSD-lflitnictioBilAppnidi 



Put I -Cliriiyini Intended Instructional Approach 
IL UiiKtioniiffttich. Check one ind complete Item lb. 

DA. LeOTffl|ol«ecthiei OH- InJtructional methods 

D B. AwBnentofleimingW : ^ 8'. liBtruction»lsettin|s 
OC. Dapowofleiiningneeds ' • D "J. Instructional media 

0 D. FlictmcQt 

D E. Student motivation 

□ F. Instructional itqucnce 

D G. Pacini. 



D IC Primary rote of student 

Q L Primary roks of teacher 

"0 Instructional activities 

D N. Perfoijnancc evaluation 



lb S«cifklnitrnc&^ More specMy/withi/lhis insln^t'^^^^^ ; 

' strite|i«bitinteodcdllutthcprc«ntcurricul^^ 
wmepowWitieswilhin each approach.) . 

2. Twchcr tutoring 
i Small group Instruction ^ 
'5. Large group instruction 



I' 



PLANNING A PROGRAM EVALUATION • 
Form 3D • latnctloMl ApproKli (Coilftiwl) 



1 



' Part 2- Setting Pnorilics for Furtbcrl 



3.^RdatJpriorily. Compared with other elemen^fctmi^^^ 



is this to out ooncems and questions? 

, Use a ntini leak of I to 5 with 
5 avciyhiihly related and 
" 1-o/ily a little related.... 



; 



Write the number 
inthitbox ^ 




\ . • Part 3- Gathering and'Using&iidence 

i iIm oA What sources' of" data wiU'pnmd'e evidence about whether these 
Swtional strategiesare actuaBy emphaaied iii the preient program 



V. 



[ 



I ReawoL 



Why should these instructional strategies be emphisiied? 



These different settings are reconwended for use-In the program 
manuals for the SCI program. The contlnatlon of Individualized 
teaching and sinall and large oroup Kiltructlon provides a 'flexible 
approach to^deallng with students' learning needs in different 
situations. 



t 



5," Judgment crilSi. How wiU the data collected by judged or interpreted with respect to our 
list of concerns and questions? 



• \ 
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PLANNING APROGRAM EVALUATION 
Form 3D • b8lroctkit|d Ap|)ro^ 



PM I *Clirifyiiit Intended Instructional Approach 



QecKoieind complete Item lb; 



D A. Le8nin|ol9cctrie$ 

OB. Asrament of learning needs 

DC Diafnosbdf leaning needs 

D D. Plaatticnl ■ 

□ E. Student^motintbn 

Df^ Instnictionalrqueoce • 

. □ a hdng, 



DH. Initructional methods 

D I Instructionri settings 

S J, Instructionalmedia 

D K. Primary roles of-jiudent' 

D L Primary roles of tfachcT 

D M. Instructional activities 

DN. Perfonnance evaluation 



. PLANNING A PROGRAJj EVALUATION 
Fonn 3D-lMbuciional Approach (Continiied) 



^ Part 2 • Setting Priorities fqi^Fuithcr Planning 

3. Relative priority. Complrcd with other elements that might be ewminrf^wb 
islhislop/cojVOTsandqucstions? * , 



[rating scale of I to 5 with 
5= very highly related and 
I =only'i little related 



lb. Spedft inatfoctkml iMqiei More specirically, within this instructional approach, what 
strategiesilit intended that the present curriculum program emphasize^ (See Appendix B-3 for 
« lome poBtbilities within each approach.) 

1. Printed texts jworkbooks,.eU 
' 5. Other - Lafcorrary.cqutjment, supplies, manipulables, etc. 



^Write the number 
^ inthisbox 



I ' ' ' Pai;3-Gtthering and Using Evidence ' 

4. Sources of daU. What sources of daU wil provide evidenqp about^whether these 
instructional strategics are actually emphasized in the present program?' ; , 

^ a. ^HaterJali checklist - Checklist to inventjory ^vaijable materials 
' b. Teacher questionnaire - Teachers rate availability of tnaterlalf 
and equipment fqr.use at appropriate times* 



2, . RcMoiis, Why should ihcse'instriictional strategies be emphasiied? 

The' SCf has a 4wll-;dcfinecl set of mcdi«^ which are intended to, be used 
; 'jn:teaching. the program, Speciffc equipment and materials are needed 
. 'for the laborattfry work which the students must perform and for certain 
' ' demonstrations., tac.h student should also ^fe^ve a workboo'k in vhich 
to record observations made' in laboratory york and to*do specified 
exercises wMch provide practice in using the conceptrand rules in 
' solving problems. ' \ 



Judgment criteria. How will the data collected by judged or interpreted with respect to our 

list of concerns and questions? 

A Jlst of materials needed for the SCI program and the quant^l^s needed ' 
for each Item for a given. number of classes and students Is contilried 
in an administrator's manual written by the program developers. Available 
quantities should equal or exceed those stated In the list' Further', 
all teachers In the program should report that all eautftnent and materials 
are available when needed. 



PLANNING APROGRAMEVAbUATIOJf 

Fom^D • liutraclionirAiiifrroich 

' 1^ 



t PLANNlNCjAPROCRAMEVALuA-lON 
Form 3D • liwiiftionil ApjrMch (Continutdl • 



f 



|>jirt 1 . Clarifying Irlenilcd InsVructional Approach 



la. inttmclionilipprMcl'. one and complete Ite* lb. 

. .. .. , ■ < 4 QH Irstrudional methods 
D A. Uaminiobjectw , ^ 

a B. AsKssmtntoflcai^gnJfcds 
"DC Djjgnosisoficaming needs ■ 



^ p[rt 2 ;^tting Priorities for Further Planning 

Itojriority, Cornparedwith#erelemcntsth.t.ightbeexaIed,howh^^^^^^^^^^^ 
, is thi$ lo our concerns and qucsiionsT ^ ^ 



■t: □ D. Placfmcnl 

Q E, Student motivation 



' ^ Instructional sequence 
D G. Pacing. 



Instructional settings'' 
Q J. InStrudioniil media 
13 K. Pnmary roles of student 
□ L Primary roles of teacher 
Q M. Instructional activities 
ON. Performance evaluation 



i^' llsea'rating'scaleofl loSwith 
5 = very highly related ap^ 
t 1 = only a littlc!tla(ed,.\'.-^ • 



•v^ 



0 



Write the numbef 
-in this box 



KcevWion -^^^ ./ . Part3.dlhenogandirsingMence • , 

* • \ .4 J?es of d.t., What sources of data will provide evidence abouf whether these 

„<^ncinstruc^n.U^tegb, M^'^ J^SS^ ^^^^^^^^^ . ' t-r^-nalstrate^areactu^ly emphasized in the present^p^^^ ^ 

regiesisitiitl^Medthatlhe^rescntcurriculunrprogramempha^^^ "T, . ^ » 

some possibilities within eacS approach,) , .» , 



1.. Accept direction . _ •• ' 
2. Assimilate Information ' 

J? .'Practice , 

Integrate and process information »^ 

5, Solve problems ^ 

6, ■ Interact with others 
7 Pursue individual interests , , 
a! Cooperate in planning learning activities 



Jleajons Why should thest tnstructionai strategics be emphasi/c^^ 



,i,cri.. ' HOW will the data collected by judged or interpreted w,« res;«ct toour 

list of conccms and questions? 



.•V 
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Form3D:pJge^of;^. 



PLANNING A PROGRAM EVALUATION 
Fonii 3D • Instructbml Approach 



Part I ' Clarifying Intended Inslriictidpal Approach 
' Inslructbnil ipproich, Check one and conipljtc Item I b. 



D A. Learning objectives 

,DB. 'Assessment of learning needs 

□ C, Diagnosis of learning needs 

□ D. Placement 

D. E. Student motivation^ 

Qf. Inslnictioni)! sequence 

□ G. Pacing. 



D H. Instructional methods 

■ D ll instructional settings 

D J. Instructional media 

D K. Primaiy roles of student 

0 L Priiliify roles of teacher 

□ M. Instructional activities ^ 

D N. Performance evaluation 



Specific instroctional ilrategies. More spcciHcally, wilhin this. instructional approach, what 
strategies is it irftcndcd that the prpcnt curriculum program emphasize'^ (See Appendix 8-3 for 
some possibilities within each approach:) . ' 

j. Provide direction . 
2. Provide Information 

Guide or ,facllltatc discussion 

5, Demonstrate * 
*6. llotivate students 
"iK Assess student progress 



PLANNING A PROGRAM EVALUATION 
Perm 3D • Instructional Approach (Continued) 



Part 2 -Setting Priorities fofFurtherPlannilg / 
3. Relative priority. Compared with othcftlcmcnts that might be examined, how highly related 



IS this to our concerns and questions? 

Use a rating scale of ho 5 with 
♦ 5 = very higl^ly related and 
1 = only a little related . 



E 



Write the number 
in this boK 



Part 3^ fathering and Using Evidence ^ V ' 

4. Sources of data. What sources of data will provi^ evidence :abolit iieth^r these 
instructional strategies arc actually emphasized in the present progrpm? / ^ . ' ^> 

. ; '''V ■ 



. vV. 



Reasons.' Why should these instructional strategics be emphasfeeJ' 

■Althiugh other roles are also used, this set of roles, representsithe (pst 
bportaiit roles of the teacher in this program.. They are roles which the 
teacher must perform In order to implement the program. 



5, Judftnent criterii. How will the data collected hy judged or interpreted with respect loour 
, list of concents and questions? • . ■ ■ 



PIANNINCAPROCRAM EVALUATION 
Form3D-lnitnictionilApproich 



T 



Part 1 -Oarifyini Intended Instructional Approach 

V, 



D A^ Uanung objectives 

D B. Asitssmciil of leamiiig needs 

DC. DiagnoJis of learning needs 

D D. Placement , 

□ E. Student motivation 
D F. Instructional sequence 



n H. Instructional methods 

D I. Instructional sellings 

0 J, Instructional media 

D K. Primary roles of sludent 

D L Primary roles of teacher 

B M. Instructional actWilies 
D N'. Performance eviuation 



1^ ^ 



\. specific in.truct^n.1 «r.«p«. , Mo. s^cifically, within '^'S inslruction^^^^^^^^^^^^ 
some pouibilities vrfthin each approach.) < 



Listening 
Writing . 

Responding to^flMe^tions 

Questioning • ' . . 

Uorkingwith printed texts, worksheets, exercis(| 
Conferring with teacher or anothe^ studtnt 
Discovering through "hands on" experience 

^Resejrching or investigating 

' Oenonstrttions , ( 
Other - Meriting with lab equipment 



2. 

' 3. 
^. 
5. 
6. 
7. 
9. 
11, 
12. 
13. 
17 

Retioni Why should these instructional strategics be emphasized? 
These Instructional activities are crucial ^° J;^!;^^;;/;;;^/;,,^,, 

S ihele Ir. the important In the teaching- learning process for 
this course. ^ 



PLANNING APROCRAM EVALUATION 
Fom 3D • iMtmctionilApproich (Conlinued) 



— r; 



Part 2 -Setting Priorities for Further Planning u 

Relative priority. Comparted with other elentents that might be eminid. how h*hly «laled 
is (his to our wnccmi and questions? 

U* a rating scale of Mo 5 with rn 
\ 5 = vcrvhi£iily related and f |jj 



5 = very highly related and ^ 
I = only a littio related 



Write (he number 
in this box ^ 



. Part 3 'Gathering and Using Evidence 

4 Sourte. of dat.. What" sources of daU. wfll provide evid^ce about whether these 
' instructional strategies are actually emphasized in the present prelim. 

■■•I 

a Observation of classes - Science supervisor observes random sample 
of classes to detcrflilne extent* of roles performed, 

b. Teacher questionnaire - Teacher ratings of ^extent to which students 
perform such activities satisfactorily. 

c. Student quettionnalre - Extent to which students report they accept, 
prefer, and perform such activities. ■ • 



5. Judpneitcriteri.. How vriU the data collected by fudged or interpfT^^ 
list of concerns and questions? 

Data wilUe examined regarding the estimated actual (fro. observations) 
an re^ t (fro™ teacher and studenfquestlonnalres) extent to wWch^ ^ 
d » rf r. such activities and how satisfactorily they per orj 
attUu^s toward s^h activities j;" ";;;,'^;"'^, " 
.ini^l competencies in such ro^es as reporte^ 1 't-" ^ " 
students sl«uld also-dencnstrate positive attitudes with regard to 
perference and performance of these activities. 



W 
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PL*NWNC A PROGRAM EVALUATION 
ForraJE-ProgriniSupppri 



Part 1 • Clarifying Inten'dcd Program Support 
* la. Projnm support opcntiqw. Check oi^aild complete ilcm fb. 




PLANNWC VpROCRAM EVALUATION 
r ■ FonnJE-ProgramSupportlCDnfinuedl 



Part 2 • Selling Prionlies for Further Planning 



V ]|i|ke priority.'- Compared wijlWlher elenufnts that mighi he examined, how highlyrclated 

4 " 



□ A. Staffing arrangements 

D B. EquipmenI' . ■; 

BC. Facilities 

0 D. Materials management. 

D E. Student grouping 

Mf. Schedule 

vts. Recordkeeping. 



i^PPpo'gir'i;i>ncerns and ques{iO|is 



JC^^;]^i«lgscai,eof,Mo5 With ^ ' ■ 
. ' - -Y/i^' only ;a litllc related. ] . \ i . 



Write the number 
in this box 



P|t 3 - Gathering and Using Evidence 



; ■, lb.:Pr<iwn wpWrt^^itrttcgiei. More specifically, within this operation, what strategies is i 



i?'4V''to da<i' What sdSirces of data will provide evidence about whether these program 



. • int^ th7'tk present' cumculum^program cmphaw? (See Appcndi^ ;B4' for. some ^Jj^piwi^ z^r^f^lfin^ in the present program 



'".^ pos«bili(ies,wilhin'cach operation.) 

f[ ' I, iFuncti'opai rMl'nlng space « ^ 
. : Laboratory area 
^" ■ fn. Othiej;i "Specif rci^iici lit les such as refrl^erdtion/.gajs jefs^ 
• as specified In manuals for the SCI prbgi^am 
■■ ■ . ^. Specialf/a'rrangemehts or' environmental condition^ 
.a. Lat)Q{,atorlesi (science) 





> 



. Reas«nii.'/w>y5hoiild these ?rfigwn\^^^^^ ^ ' 

,1 ■ , ^ 'y; / ., , . . 

■Jhls Is a",lijiij|h S4jj^|le\)t)^ciencc course witii t^refullf specified • ' 0)!^r 
_/cxperijj|nt5 .and iPioi]stratiws. wh^^^^^ are esstntiaLto reaming the facVsv ^j^ft^^^rji*^' 
■ ..J:.liicWeptVwjf^ etiif ^OeinOQStr^rj is a powe'/fuKway of teaching an^ 
\;^^'^cienc^*& " ' ' r 'ji^^^^i^ 




Rcria. (bw \frill the data collected be judged or interpreted with respect to our 

fniernsiindquejiliofls'f 



- ^;^-i^'5Cienct;flenonstr^ti9n5.re()i 

■^'■i'\M^}!'¥r '''''' 




4. 




.' * S I 



PLANNING AfROCRAM EVALUATION 
FomiBE-Proiniii Support 



hrt I • Clirifying Intended Prognm Support 
U. hoffinnopportopetitioM. Qieck one and complete flcra lb. 
U A. Staffinj arrangements 

D B. Equipment • ? 

* Df. Facilities 

D D. Materials management 
B E. Student grouping 
D F. Schedule 
1 DC. Recordkeeping 

>• 4 Mnrf «rvcificallv within tliis operation, what strategies is it 

possibilities wilhin each operation.) 

. of 8th g ade science grades; Standard Aptlt.de est scores 

, .Mined lerbal and n^rical subscores ; nu^er o SC 1 ^du Us 
comoleted in 8th grade; teacher recommendations; and stildent and 
parent request. Students with the.hlghest f ij^jj '"^^^ 
and grades go into either a biology course or "t^"''*' 
physics Jse Mich Is highly n^^e^tlcal) The re^ Wng 

students, roughly one-third of the total , go Into the SCI 
program. 

Reasons. Why should thesi' program support strategies k emphasized" 

T-hls (irouDlna systen is intended to provide students with greater^^ 
!™ r e science courses suited to their abilities, Lferests. 

r;rX;U (sSnce bidcgy and physics students are usually those 
In going to college). 



RANNINC A PROGRAM EVALUATION 
Form 3E • Program Support (Continued) 



• Part 2- Setting Pnorilit?s for Further.Planning 

3. Relative prionty. Compared .ith other elcnienls that n,ight be e^ined, how highly related 



in this to our concerns and questions. 

Use a rating scale of 1 to 5 with . 
!i = very highly related and 
I - only a little related, ...... 



(f 

0 



Write the number 
in this box 



Part 3 -Gathering ami ^sing Evidence 

Sources of data, What sourc^ of data will provide edence about whether these program 
support^strategies are actually emphasized in the present program. 

5t^d*nt records will supply Standard Aptltud.Test j;;;'' l';;'"" 

t St scores and a nuinber of SCI nodules completed. A random ample o 
Zm^Z records .III be examined (100 fcr.current C stu 
50 biology students, and 50 phj^Iu students) by teaclie s and hi for 
Stion c^ led fro™ them, Student na^s will not be copied, only data. 



J^dg^n. critera Ho* w.ll the data collected be judged or iuterpretd with re,p,.t to ou, 

hslof concerns and questions'' . ^ 

Aptitude test scores (verb^, numerical, and romblne^), """"J^;"! ' 
;;;,es. grade point a.eragrs. and nujer of ; , 

be tallied and averaged for each stu ent group " j ° 
physics). This data will be examined to determine the relative abllfty 
and achievement levels of the three groups. 



\ 



Instructions for 
Completing* Forms . 



if 
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Before you begin. . . 

Figure 2 shows the five steps of planning the ijbgratn evaluation and their relation to the 
forms which the planning committee wiir complete. ■ . 

Master copies of the forms are in Appendix A. Reproduce the needed number of forms by 
photocopy or other duplicating methods. . 

The instjuctions f^J^Tcompletiag the forms ?re presented in the foijo\ymg order. Tht forms 
must be completed in tnis order. ■ . - ^Vu 

1. Form 1 -Clarifying Concerns and Questions V '--^ 

V 2. Form 2 - Summarizing Basic Program Information * - ^ 

3. Form 3 A - Student Outcdities^ . . . Part 1 - Clarifying Intended Student Outcomes 

i 4. Form 3B - Curriculum ConteAt^. . Part 1 >- Clarifying Intended Curriculum Conlent 

•5. From 3C - Content Sequencing . .\ . Part'l - Clarifying Intended Content Sequencing 

• 6. Foiln 3D - Instructional Approach . Part 1 - Clarifying Intended Instructional Approach 

7. Form 3E-Progt^ Support Part 1 - Clarif>;ing Injtei^edl^rogram Support * 

' . 8. Forms 3A through 3E ; Part 2 - Setting^Triorities for Further Planning 

9. Form 3A - Student Outcomes . . . . : Part 3 - Gathering and Using Evidence" . - ^ 

♦ * * 

10. Forms 3B through 3E Part 3 - Gathering and Using Evidence - 



Step I - Clarifying Concerns 
and Questions . 



Step2-Siilnmarizing Basic 
Prpgi?mlnformation 



Step 3 - Clarifying Intended 
Prograiji Elemetits 



Forml 
Clarifying Concerns 
> and Questions 



•F1GURE2. - ^ 
Completing The Steps And Fo;ins For Planning A Program Evaluation 



Form 2 
Summarizing Basic 
Program Information 



Form3A 
^Student Outcomes 

'Paftl 
Clarifying Intended 
Student Outcomes 



Form 3B 
Curriculum Content 

Part! 
Clarifying Intended 
Curriculum Content 



•Form3C 
Content Sequencing 

' J>art 1 
Clarifying Intended 
Content Sequepg 



' Fonn3D 
Instructional Approach 

Parti 
Clarifying to,tended 
Instructional Approach 



Fonn3E 



Parti ^ 
Clarifying Intended 
ProgiamSuppprt 



,Sfep 4 -Setting Priorities for 
l^urther Planning 



Step,S -planning to Gather 
and Use Evidence 
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Form 3A 
Studen\ Outcomes^ 

. Part2 
Setting Priorities for 
Further Planning 



FormSB 
Curriculum Content 

Part2 
Setting Priorities fof 
Further IJannuig 



R)m)3C' 
Content Sequencing 

Part 2 
^tting Priorities for 
Further Planning 



Form 3D' 
Ij)/tructional Approach 

Part 2- 
Setting Priorities for 
hirtherPlann'mg 



Form3E 
I^m Support: 

Part 2 
Setting Priorities for^ 
>FtirtherPlaniliiig 




Form3A 
Student Outcomes 

. Part 3 
Gathering and 
Using Evidence ' 



Form3B 
Curriculum Content 

0 

■Part 3 
Gathering and 
Using Eviaence 



" 

' "HP 



Form 3C 
Content Sequencing 
i ■ I 
Part 3 



Using Evidence 



Form 3D ] 
Instructional Approach 

Part3 
Gatheritigand 
Using Evidence 



•FontiSE . 
Program Support 

,Part3« ; 
V Gathering an^ 
Using Evidence 
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* INSTRUCTIONS ' 
Form 1 - CbTif ying Cyifierns afi(Stjuestions 



Before you begin. . . ^ 
^ Discuss>ltie various concerns which comnfittee members ha« -'-about, the 
curriculum program.' If you have more tliat 4 or 5 conc^sVyau may have too many 
to deal with reasonably. Try to combine or eymiiMte some of them. YoH wUl need 
to complete one copy of Form 1 for each concern. 

Item 1.. Concern ^ . ^ . ^^"^^ 

Briefly sum?^rize the nature of your conc^ in a short, paragraph.. You may 
Tind- it 'helpful to give each concern a shoh title (2 or?" words) by- which to reftr<o 
it later on. . y - 

Item 2.,Basis for this concern \ 
' Briel'fy summarize your basis for feeling that' this\a concern. The"basi* for 
• yoQr concern might be some direct evidence such as test scores, survey results; or 
personal olsw^atipil; biltjt could also be reports from others, complaints,^ Jogical 
deductions aboat a sififation. ■ ' ? ^ 

I^m 3. Possible questions associated with this concern. , ^ , 

i^Write few questions related to' this concern, which .you' would like the 
' evaluarian to answcf. Try to limit your list to two or three succinct questions. They 
should the kmd ^^f questions which can be answered bi^atheringtlata on actual 
status of tfie progranf^ , , " ^ . "'^^^ * 



' INSyRUCTIONS ^ 
Form 2 - Summarizing Basic Prosy^m Informition 



Before you biegin. . 



Be sure that you have, access-to cujtent student entailment data for- the 
program including, if Ji^ces^ry, breakdowns by sub-groyps (e^., sex. raceg school, 
etc.). . ' ■ 

^ Part 1 -Identification ^ 

- «. . • . 

Item 1. Program title. , - 

Give the full official title of the program being evaluated. 



Item .^.Content ^ 
Briefly describe the c6frtentr»C:the program. 



Item 3. Sources and references on the pr»»CTam. . ' 

'Lisi all' v^ritten do<iments which Vld be useful in under^anding^lhe 
^rogrtm ms c^' include student texts, 1^ of program object.ves^^teache^ 
manuals, and ^ther important documents. ( . ^ ^ . 



Part 2 - Personnel 0 



Jtem 4. Program Director^ ' . » 

Give the^n^e of the person in charge *of the progran^^^^ 



Item 5. Staffing. , . . . - . . , , 

-List the names of all district personnel associated with the program. Include 
administrators teachers, aides, an« any "other, relevant personnel. Indicate the 
^Sltle^^^^ and whether they are a.ociated with the program on a 
part-time or a full-time basis. * ' 

'Part 3<i §tiidents ' .• : 

Item 6. Locatiotis at which program is used. ^ 

List thcexact names and locations of all sites where the program is used. 
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Item 7. Student populations associated with pOtogiahi; 

List the €xact number of students associated with the program. Do not use an 
estimate. If any of th^ questions you wrote for* Fom 1 imply comparisons.beftveen 
student sub-groups (such as comparing boys and girls; or comparing students in the 
program to those not in the program), you should give the number of :students in 
each of the sub-groups. You may alsp* provide here-acrbrief description of th^i 
charactedstics of the student pppulatio^n and^of t^e gpmfnunity, if you feel it is 
relevant to your concerns and questions.' 



^ . INSTRUCTIONS r 

. ■ ' Form 3A - Student Outcomes 

Part 1 -Qarifying Intended Student ■Outcomes ^ ' 

Begin you bsegin. . . ^ * ' • ■ 

Review your concerns and questions and determine ^'^t kind^of student 
behalr youf e interested in. You wifl need one copy of Fomr 3.A for «*chjype of 
outcome checked in Item la.. •» ' ** 1^ 

Item la. Type of outcome. , - " ' 

^ Check onliT one box on each copy of this form. You may check as many bo^s 
as yo?lant, butonly one box for ,ach copy. In effect, provides .t.tle o. theme 
for the ^e5t^ofth^ form. . ' 4 V 

' Item lb. SpecificaDy, students should. . . v ■) ' [% * / 

Further specify this type of outcome.^ completing^this ^'^XTl'^^xZtZ 
more than one outcome specification i« Item Ib^you may w^t tq put them *n. 
separate copies of this form. , * % 

Item 2. Student behafiors. 

• Ust some representative student behaviors -^^^'f^'^^'^^^'^i^^^^^ 
outcome Make this a*sdecti^e list«of the most in^o.rta.t belfeviors.^, Behav»ral 
XXes' are too specffic. Aim for behaviors whic*h are^betweea gener^ types of 
•Jtud nt outcomes anS very specific student behavioral I" ^^-^^^^^/^ ^.^^^^^^^^^ 

Part 3 this form, you^ill have to 'Aiggest ways of c'^llectirife data about these behav- 

iors. ' ^ ^ ^' * ^ 



nNSTRUCTIONS.f . ' • 
' iS'orm 3B - C&rrieulum Content 

Part 1 - Clarifying Intended Gurriculum Content 

Before you begin: . f — 

Review your concerns and questions and the checklist of types and sources of 
content in Appendix B-L^ecide which types and sources of content are relevi^nt.^ 
your concerns -and questions. You will need 'one copy of Fbrni 3B for each box 
checked in Itefn 1 a. ; , / . . ' 

Itcii^la/Sourceof cpntpnt. ^ ^ 

Check only one box on each copy of this form. You may check as many boxes 
as you wa^it, but only one box for each copy. This provides a tiUe or theijie for the 
^rest of the form. 

■ ^ 

Item lb. Types of content . d 

List the specific- types, of oonj^t- within this area which ^JBknciilum 
program is Intended to emphasize. Use the checklist in Appendix B-kffflpffitance. 



Item 2. Reasons. 

Briefly state your reasons fc^'^hoosirig these types of content. Y< 
choosing some types of content might be related to desired studen^!^a\n 
existing student characteristics. V^our reasons might also, be ^eViyed f oi^>| 
experience, or from assumptions about student learning. It is impbrtafti»#Vou 
have a consistent set of reasons to justify your intended content. 
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/ ' ' ■ INSTRUCTION^; . " -A.^ 

t * , / / Fonn 3C - Content Sequencing ' 



Part 1 - Clarifying Intended C^tent Sequencfin^f 



Before you begin. . . ^ ■ ■ 

: Review your concerns and questions and tlje ch^ckli^^ of cpntent sequenfcin|. 
Principles ii, Appendii B-2. Notice also th^ this fofm is direcfl^ tied to your 
' Tesponses on Form 3B. You will fhereforrneed one copy of ^prm 3EC.for each tViJe 
of content which you listed in Iteni lb of Form 3"B.' * ^ ' ' ■ 



Item la. Type of co^^ . ^^ , 

. K - 'Usfliere drily^oiie type.of tontenfefrom l^m^lh of^qnS SB: * ^; 

.......... ... . ^ . .^^ . , :v^^'^t5^' 



' V : : ; aie(?i only one box to desisttate the intendejf ^'urfe .oC thexofit^nt sequen^g: 

• ' princifces for this type of content-.- ; ; ' V' 

. t-'::.--? 

^ * . ftem fc^^^^^^^ * •« * " * * ' 

/ ^ ' ■ - : ■ 'List 'ftie s^ecific'coiifent sequencing principle to %em^^»si^for ti^^^ 
.' : " .brcbntent and'sdurce of principletU?e the checjtji^^ln A^pendbc ^for assistance. 

':^^■'Jtem^2;■Reaspns.. ■ 

^ firiefly^. s^^^^ for choosing ^these ^prificiples/ Youi^aso^ for 

' > ' ' cHdosing sonie. sequencing will be clearly 'rplated^Q4<h^ t^es of S^itent 

^ . y^^^ will be rela^d to ^sired student behaviors 

jWtfy yburmtend^^^^ ■\' jfj^ ' M^/"^ ^ 



4' 



5- 




DESTRUCTIONS 
J Form 3D -instnictianal Approach 



mim^y^f 

Vv^^ Intended Instructional Approach. 



•V^^^'lj^^^^^ , questions and? the checklist of instructional 

::ippr^8ifesj|n ill Appendix B-3. Decide which approaches and strategies • 

are ret^Vta^^ and questions. You will need pnf copy of Form 3D for 

Ke^eh boxi^recjlced i^/Item la. 



^^'Itistni^tiorial approach. 

fonly one box on each copy of this form. You may check as many boxes - 
^[^.W^^y^l^ l^ut only one. box for each copy.. This. provides a titfl or theme for the- 




i^t^peclfic instructional strategies within this approach which the curriculum 
Apr^a^as mtfertded io emphasize. Use, the checklist in Appendix B-3 for assistance. 

i,v|tent;i. Reasons. ^ , • ^ 

:En^ state your reasons for choosing these strategies. Your reasons for some. ^ 
sliiiitegies may be related to desired student behaviors, student characteristics, or the 
^t)|^.of cottjent. Your reasons may also be derived from practical experience, or 
'ifj^li^^ ^out student learning. It is important that you have a consistent 

of reasons to juSlify your intended strategies, o 

r . ■ 



I' 
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INSTRUCTIONS V ' ' 

Form 3E - Program Support > 

i ■ . 

Part 1 -Chirifyiiig Intended Program, Si^port 

: # . . 

Before you begin. . . • » ^ 

Review your conceml and questions and th^|j|ecklist orprogram support 
operations and strategies in Appendix B^. Decide, jlich approaches and strate^es 
are relevant to your-concems and questions. You wiffneed oi^py of Form 3E for. 
each box checked in Item 1 a. ' I "^x^ 

Item la. Program support operations. • 

Check only one Box on each copy of this form. You may check as many boxes^ 
as you want, but only one box for each cQpy.. This provides a title or theme for the 
rest of the form. , ^ 

Item lb. Specific program support strategies. 

List specific support strategies within thi? operation whiCh the program is. 
intended-to emphasize. Use the checklist in Appendix fr4 for assistance. 

Item 2. Reasons. 

Briefly state your reasons for choosing these strategies. Your reasons for some' 
strategies may be related to desirfed student behaviors, student '^haractenstics, type 
of content, or instructional approach. Your reasons may also be denvfed from 
practical experience or from assumptions about student learning. It is important that 
you have a consistent set of reasons to justify your intended strategies. 



^ INSTRUCTIONS , 

Form 3A - ^tudent Outcomes 
Form 3B -r Curriculum Content . . 
Form 3C - Coi^fent^ Sequencing^ ' 
Form 3D - Instructioiial Approach 
" Form 3E - Program Support 

' ' Part^2- Setting Priorities for Further Planning \^ 
* * ' . - • - 

Before you begin. . . ■ 

Aswmble co'pies of: all the above f6rms with Part ^completed. If it is within 
your budget, it would be best to haye a complete set for each committee member. 
' • v \ , ■ . . 

Item 3: kelative priority. ' 

- . 4f your- committee is typical, you now iiave a large number of program ' 
elefnents which yoijiwant to examine. Probably you have top many to dareasonably 
* Within your budget^ and time constraints. If you keep too fnary, you may not have 

the resources to gather reliable and valid.evaluation data on aU of them. It.is better , 
' to, do a few cdhcerns and elements-weli than to do too many badly. This part of ' 
Forms 3A through 3E I's designed to help you select only those which'are most 
important for your evaluation^ 

The rating scale goes from 1 for elements only a little related to the concerns 
and questions to 5 for elements for very highly related to them. Use only 1, 2, 3, 4, 
or 5 in making ratings. Do not use finer.ratings such as 3 1/2 , or 2.7. 

' You may also wirS't^er other factors in making your ratings than how related 
an element is to your t^ttfieems. Some elements may also have to berated for their 
political value or risk-. Data sources-haVe not been mentioned yet, but you may want 
to consider for some elements whether it would really be practical to try to gather 
data about them. There may be other factors of local importance to you. 

'How you conduct the rating prpcess is up to you, but two methods are 
commonly used. Thi first method was illustrated in the case study. The committee 
members each rate the elements according to their individual feelings. Thw the 
members' reveal and discuss their ratings. Elements which receive high ratings frorrt 
all members are .retained for further plaraiing. aiid those which receive low ratings 
from all members are put aside. The committee discusses the remaining elements, 
which received a combination of high and low raUngs. and arrives at a consensus for 
one rating. . . . 



In the second method, the committee members go directly to a discussion 
without first rating the elements individuaUy. The committee arrives at a consensus 
rating for each element. Elements with high ratings are retained and those with low 

ratings are put aside. . • <■ *v,a 

It is not recommended that the committee try to average the ratings of the 
individual members and arrive at a consensus that way. Such a "statistical 
consensus" short-cuts the discussion which is so important a part of this planning 

process. ' ■ • a e 

bo not throw away the forms for those elements which are not retained tor 
further planning.' Save them for use in futute evaluation plans. Remember that doing 
an evaluation should not be a one^hot affair. It should be something which you wiU 
do this year, next.year, and the year after that. .Concerns, issues, and questions wi 
change year after year, and even if they remairi^the same'; the answers to them wiU 
change. Then too you may not have the resources to answer all the questions you 
would like to answer this year and may want to save some of them for next year. 



V. ' INSTRUCTIONS , 
Form 3^ - Student Outcomes 
Pali 3 - Gathering and Using Evidence 

Before you begin. . . 

AssemWe all the forms. for the elements, which were retained as a result of the 
priority rating process. Review the infdrmation in Table 1 Possible Sources^)f Data 
for an Evaluation. . • ' 

. - ' ' ■ ' 

Item 4. Purees of data. ^ • / 

Indicate what sources of data you will use to gather evidence about this student 
outcome. Be' as specific as possible. Give names of commercially available 
■standardized tests if these arc to be used. Give ^ description of any other measuring, 
instrument. If you are going.to Cjonstruct the instrument, say so. 

Try to choose sources of data which are appropriate for this outcome^and type 
of student, and which will provide vali^ and reliable information. You may want to 
combine data from two or more sources. For example, standardized tests results can 
be combined with criterion-referenced tests. 

Item 5. Measurement criterion. ' - . - 

Describe the minimum, acceptable fevel o'f student performance-in quantitative 
or qualitative terms. Usually measurement criteria are directly associated with or 
implied by your source of data (e.g., norms for a standardized test). You may 
include both objective and subjective criteria. Set your criteria at levels which your 
students can achieve and which reflect reasonable performance expectations^n terms 
of their characteristics. « 

Item 6. Students expected to meet standard. j, 1 

Specify the -students who are expected to meet "the. measurement criteria. Be 
specific; avoid wo/ds like ".the majority" or "most."' Consider also whether your 
criteria are appropriate for all students. You may'wish to express criteria differently 
for different sub-groups of students. 

* ■ ' " ' ■ 

Item. 7, Population characteristics; V 

liidicate what characteristics might be^uspful to know in interpreting the data. 
Among the factors that might influence the rdsults are ability, motivatipn, social 
■■, factors, personal goals, learning difficulties, and'leafning styres. 



TABLE 1 ' ■ , 



POSSIBLE SOURCES OF DATA FOR AN EVALUATION 



e 

€ ■ t. ^ ' 



Sources of Data .. Examples 



I 



Expert reviews.. . . . . ? Review oF curriculum materials by a university^ 

, consultant * ' 

Documents Sdjopfboard policy statements 

Questionnaires : Community survey 

(byfflailor.phonfe) Student attitude survey . : 

Teacher questionnaire 

Observation . . . . Formal observation of teacher-pupil interactions in the 

classroorn 

Logs or diaries . . : . .-Teacher log of conl^nt- taught andi^ctivities performed 

Test results'. . Nationally standardised ability or achievement tests 

. Criterion-referenced tests ' * 

Teacher-made tests ^ - ' ; * 

Group meetings Teacher planning sessions . . 

Conference of community and school representatives 

Interviews , • • Interview with subject area specialist 

Interviews with parents 

Media . . i. 1 . . - • Newspaper articles { 

Personal contacts . Informal discussions with-students 

Follow-up studies* Survey of recent graduates ' - 

Professional publications .... Research reports - . ' 

Professional journal articles 

.Existing records Student files (achievem"ent ^nd aptitude test scores, 

- grades, etc.) 

Work sa;nples . .' • Student writing samples , 

• , p ^ Student science projects f * 



Form 3B - Curnj^him Content v 
i Forra 3C - Content Sequencing : 
^ F6rin 3to t Instructional Approach 
-ForiKJEr>'Program SuMH)rt , 

^ Part 3 - Gathering and tising Evidence 




Before b^gin. « 

Asfemble all the fopus for the jelements j|hich were retained as a-*<Sulf of the 

ptiocity rating process. Review tjie .information in TaWp. 1 Possible:,SourCe.s of Data 

for an Evaluatipn. , ' ■ . 

■ ■ • " ^. , . ■ . ■ 

Item 4. Sources' of data- * . ^ 

^ Indicate what sources of data you will use to gather levidenc^ about this ' 
program clement. 3|5 specific as possible. Specify both the kind of instrument and 
exactly What information It wilh gather. Tiy, to choose sources of data which are 
appropriMe for this element, for studehts and staff; and which will provide yalid and 
reliable information. You may want'to combine data froni two or more sources. ^ 

Item 5. Judgment criterion. - » » 

Describe how y^u will judge or interpret the da'ta whfch you cojJeCt, with 
respect to your original list of jcOncems and questions. Yop; will want to. specifj^ ho\y 
.the <iata will be tabulated or summarized. Haw. you sumrrtefjze and analyze the da^a 
will be influenced by both the questigns you want to an^er apd the nature of th« 
d^ta. Consider the implications of different possible results.;:. . 




Seeking Further 
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Why seek assistance * ^ - ' 

^ All of the forms completed by the committee comprise the evaluation plan. 
Jhe dist^ct now faces the task of executing that plan. If no member of the planning 
comm|ttee has tiamin^ and experience in conducting an evaluation, theq ^sistance 
will be needed from a person who does. In this section of the handbook, we will 
refer to any such person as ^^'cpnsultant." 

What makes a consultant ^ 

There are four qualities to look for in a consultant. The first, and most 
important, is fecAj7/ca/5/rf/&. A consultant^ should beable to: ^ 

• Etevelop tests, questionnaires, checklists,^nd other instruments, 

• Conduct statistical analyses of data collected, including the use of 
computers if necessary. ^* 

• Develop a management schedule for the various tasks involved in 
conducting the ^evaluation, ^ch as dates when instruments will be. 
d^elope^d, tests administered, or reports written. 

• Handle the practical details associated^th large scale test administrations 
and community surveys. * V 

• Vhite reports of tHe results of thev evaluation which comdiunicate 
technical ideas to non-technical audiences^ | 

^ A second important quality of a consultant is interpersonal skills. The 
consultant must be able to understand the concern^ of ji^istrict and work with 
district staff. He'must be a "team player.J* Conductmg an^Waluation is often filled 
vi^th tensions and pfessures which make it inrfportant that everyone concerned work 
tpgelther. Remember that the district properly controls both the planning and the- 
execution of the evaluation. The consultant is expectedTQ exercise technical 
IcWership, but should not be expected 16 completely control the evaluation effort. 

A third quality is that ef "having co/2ce/>/wa/ fkills, A good consultant must be 
able to interrelate and integrate all jjieceWbf the evaluation plan into- a working 
whole.^ He must ||so be able to see beyond the immediate concerns and questions 
that led to the evaluation ^jlanning and^ identify other issues that might b£ crucial for 
consifleration. A good consultant often suggest? changes that 'make a vplan more 

. effective' » Be open minded^ recon^mendations by t^ie consultant. On the o^ec 
hand, do not allow a consultankto transform the commhtee's ev^iluatioii plan to one 
thatiits l^is fafvorite framework. ' ^ ♦ * 



* A^fottrth qiwbty-to loolc for is experience. It is proper and advisable to adc a 
^)Otential consultant fpr evidence of his previous evaluation experience;* ai^/fpt 
feferehces who can be contacted to obtain assessments of his work. 

Where t&fmd a consultant 

A lconsultant may be available within the school district. Some districts have 
full-time evajuators who evaluate /local programs and administer testing progranis. If 
* not; there are Other places to look.^ 

Many states now -have regional service agencies which provide evaluation 
^ / ; afflikance as part of their services. These agencies are known by different names in 
different states: Pennsyjj^ia^calls th^m Irttwmediat^ Units, New Jersey calls tl^m 
; [ EduQational Improvement Centers, Texas ^s them' Regional Educational Ser^ce 
' Centers, and so on. If there are such agericies in your state, they may be able to 
provide evaluation assistance g# recommend someone who could. 
fi Local colleges or universities ate also sources of assistance. Look especially fof 

someone with § background in educatiqnal evaluation. Faculty members ofteri (io 
consulting and, in' schools with a large graduate program, advanced graduate students 
may also.be aVailable. " ' l\ 

Regional •research and development- laboratories ynay be another ,sburcj 
' assistance. There are a number of such -agencies around the country. ^Researen for 
Better Schools is one of them. , * ^ ' L - ♦ 

^ Th^t ar^lsb many private agencies and individuals "^ho sj)eci^ize'in Assisting 

^ V schooh ^istrtiT^ fl^ doing^evalu^tions. They sprnetimes advertise |pr send 

promotiormiterature to^t^ or your superijnte|fdent. 

More aboujf cj|sts / ' ' ' I 

Be^-'^ih mhijl, that just as there were costs ass^piated^ith planning the 
^ evaluatio'n, thefS^ll be costs associated with executing the ^valJalion pfenyC. ; 
Evaluatiojjs tepd to be very labor . intensive, and^ thus a majpf Cost is 
professional time, especially that for the consultant, Mo^l copsultantstharlge by Jhe 
Others?will give a 1)ackage price for their services Jor the compete evaluatfon. 
^Sometimes the- package price v/ilj^ include services such as computer pro^sang. 
^ /However, .consultants from regional service agencies usually dd, not maBe such 
^\ ' chaiges; services to local district arf part bftheir*fesponsibilities. 

• ' Just as the costs of involving "teasers in the evaluation planning had to be^ 

J* " considered, so will the costs for conducting the e)?aluatiQ|i. Qass'time may have 

be .taken, for- administerinjp.^hT§Truments to^tudents.' If teachers must answer 
74 " questionnaires or be interviewed, timq^ust^be allowed for these activities. 
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Mai&rjjils and instrtiment ^cbsts are iiivol^dMh the purchase of c(5mniergii 
-made tests. If instruinents are^lopally^ constructed; ^sts must be allowed for pap, 
and printing, and for time to* write ^nd tes^ the^ . ^ 

^ Data proces^g may be another major expeqje. Computer analysis bl^ata 
idclude /costs for keypunctdng cards, progfamming service!', iihd 
,^jd§Vmay -be keypunched using the districl^s services; if so, the cl)rrect p 
^tardTorm^t ^puld first' be confirmed with' your, consultaht^- Do not cp 
pro^cc^sing data throij^ district's wmput^r servicts. Such services a 
idlbisigned for 'administH proems sujch as budgeting, att^d^nce,^ ' 
leporU and not for s^Gstical a^^ j . s * ; ,| ' 

Imh or without the'xornpute^ costs must, b?f estimated, for Mrsoft^o.cj0^and 
tabulate the data from/fte original irvstruments, %\ to purchase commercial test 
scoring services for staridardjzed tests^ ' ^ T \ 

Reporting findings'-andvcdhcTusions involves c6sts that include tim^rto-write the 
-^port,' to have it reviewed, jjpd to*j^pe and^print Jhe final copy. ^ ' ' ^ 
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Appendix A • 
Master CojJies of F G^rips : 
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T^is ajipendix contains full-size copies of all.the fomis which the evaluatipn\ 
l^anning.coninrittee must co^nplete. To use these forms', simply tear therri ojat^ffim * 
off the'^ raggwl edge, and reproduce them by any ^otocapy or oftsci^pnntinjg * 
ionei^od. Be sute to ha\^ sufficiieijt copies printed for all the committee members to * 
use in the piannin^ pcDcess. /• . , ' / 
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' ^I^^^^PC^^KNING A PROGRAM EVALUATION 
C .Form 1 ^Clarifying Concerns and Questions 



± 



1. Conc^." 



-7 



e 
/ 



jj. ^ Basis /pr this yconcem/ ^ 




3. J'os^ble questions associated with this concern. 




PLANNING A PROGRAM EVALUATION 
Form 2 - Summarizing Basic^Prog|am Information 



1 . Program title. 



2. Content. 



Part 1 - Identification 



( 



3. ' Sources and references on thelprogram. 



r 

4. 


^ ^^^^ 

, * ^rt 2 - Personnel ' 
Ptogi^m Director. 




r 




5.. 


Staffing-. ^ 




0 






m ' ' 


\ 


1 

• 


















' 4 




f 

1 ' 
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Form 2:/page 1 of 2 



PLANNING A PROGRAM EVALUATION * 
Form 2 - Summarizing Basic Program Information (Continued) 



Part 3 - Students 



6 . Locatioiik^ whig^ program ^^^ed. 



7, Student population assocjated with program. 



Vs - 



X ■ 




Form 2ip)age 2 of 2 



, PLANNING A PROGRAM EVALUATION 
^ . form 3A • Student Outcomes 



* 7 ^ ^ Part'l - Clarifying Intended Student Outcomes 
TyjitTotpOtcojiie/ Check one and fcdmplete Item' IB. 

□ A. Infonnation recall 



la. 



lb; 



□ B. Basic skiH~^ ,^ 

□ C. ^Higher^Drder processes 
D. Support dcills ' • 

Specifically, students should;;, r . 



n E. Attitudes ' 

□ F. Values " ^ 

^ * n G« PersonaJ cfevelopment' 

n H. Social development 



1 



Student behaviors. What are some representative behaviors for this type of outcome? 



Part 2 ' Setting Priorities for Further PlaTianing < 

Retafive priority. Compared with other types of outcomes and student behaviors that might be 
examined, how highly related is this t-o our concerns and questions? 



Use ratihg some of 1 to 5 with^ 
> S.='^very K^ly related and 
,1 = only a.little related^ . . . 



Write the number 
in this box" 
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Form 3A: page 1 of 2 



PLANNING A PROGRAM EVALUATION ^ 
'¥om ^A - Student Outcomes {Continued) 

— : ■ '. 



Part 3 - Gathering iitt Using Evidence 
4. ' . Source of data. What source af d^ta will provide e>fidence about this outcome 



9 



4 



< 

5, Measurement criterion. What is th^^ininwi^acceptable performance for an>individual 
student? ' ♦ \ . ^ ^ 

~ ' : ■■■■ .\ ^ ' - .^ 



1 



6. Students expected to. meet standard. Hov^many students in oiir population are expected to 
meet this standard? • * * 



• i 



7. .Population characteristics. What characferistics of this population are useful to know in 
interpreting their performance? * ' / 



PLANNING A PROGRAM EVALUATION 
Form 3B - Curriculum Content 



^ — — — ^ ■ 

^) Part 1 - Clarifying Intended Curriculum <^ontent 
la. Source of content. Check one and complete Item lb. * 

* \ ■ * ' ' ' 

f ] ^ ^ A. Traditional academic disciplines 

J \ □ B.. Personal experiences of students 

* DC. Society as an environment . 

□ D. The world of thought ^ * 

lb. Types of content. More specifically, within this subject matter area, what types of content is 
it intended that the present curriculum program emphasize? (See Appendix B-1 for some 
possibilities within each area.) 



r 




2: Reasons. Why should these ty pes of content be emphasized? 



r 



Form 3B: page 1 of 2 



PLANNING A PROGRAM EVALUATION 
Form 3B - Curriculum Content (Continued)^ , -* 



Part 2 - Setting Priorities for Further Planning 

Relative priority-. Compared with other eleme*nts that might be exariflned, how highly related 
is this to our concerns and quest Tons? . ' 



Use a rating scale of 1 to 5 with • ^ ^ 

5 = very highly related and \ - k 



. 1 = only ^ little related . . . -Write the ni fnber * \ 

* ' in this box ^ . 

Part 3 - Gathering and Using -Evidence 

4. Sourcesr of data.^ What sources pf data will provide evidence about>^whether^these types of 
^content are actualljT emphasized in the present program? f ^) ^ ' • 



. \ 

} 



T f. 



5. Judginent criteria. How will ^he data collected be judged or interpreted with respect\to our 
list of concerns and questions? , - . 



i 



\ 

\ 



^ , \ ' ' ' Form 3B: page 2 of 3 
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FLAWING J^P^GRAM EVALUATION 
Form 3C - Conteil Sequencing 



" ^ ' 'Part 1 - Clarifying Intended content Sequencijig 
■ ^ ^ 1^. .-^ • ' : - 

a. Type:oS content (from Item lb on forrtr 3,B>r / .( ' ' - ^ 

' * . ' • ^ . . * ^; 

• V ' ■ X ' % ^'^.\ /'^^ . * 7. * 

1 b. JS5ourctft)f coptent seqoehclng j^nnciples. TVie inte'hded source for this type bf-cojfterit. Check 

.one andcompletfe Item Ic. . / ^ " 

^ * * . • - ' ' -* . 

tl A. Experience or Qt)servation of f he -world ' ^ 

□ B. Logical str^icture efex^istipg knowledge \ . 

. C. Mqjjiods^f intellectual-inquiry ^ V ^ ' - *fr"-; 

, ^ '^^ □ D. ^ Assympti^ns about the psychology of learning ' • ^ - . • 

□ E. Conditions Cindei^hich knowledge^could be usecl. >.^^ ^ 

Ic. X^ontent sequencing principle^. Mo^e specifieally, for ^s'ty^of content anlj for this source, 
what sequencing principles is it intended that fheT^ffeSbrtt curriculurw program, emphasize? (See 
^Art^dix B-2 for some possibilities withiR each source.) , 




2. Reasons. Why should these principles be er rjp hasized? 



r 



J 



Form 3C: page^l of 2^ 



Kanning aerogram evaluation 

Form 3C - Content Sequencing (Continued) 





Part 2 - Set 



tin^ Prioritie^^for Further Planning \ ^' ' 

/^3.^ Relative priority. .Compared wikh dihtt elements that might be examined, how Kighly related 
^ is this to our concerns and^iuestions? v , 



Use a rating scale ofsl^to 5 viith ^ ' / . i ^ ^ 

5'= very highly related Ind • • T 

1 = only a little related. I I 

Write tne. number ^ 
\ ' ' * . in this box » 



, Part-3 - Gathering and Using Evidence j . " 

4. Sources of data. Wliat sources of data will provide evidence about whether these content 
sequencing principles are actually emphasized in the present program? ' 



5. Judgment criteria. How will the data collected be judged or interpreted with respect to our 
list of concerns and questions? . j 



i 



brm .SC: page 2 of 2 



, ^ .p^,anningw\prdgf;am evaluation; 

**^orm 3D - Ipstriictional Approach 



Part L - Clarifying Intended Instriictional Approach 



\^d: Instructional approach. Check oneand complete Item lb. 

□ A. • Learning objectives ^ ^ □ H. Instructional methods I* 
B." Assessment of learning needs • n-I. InAri+ctional settings 

DC. Oiagnosi^^eaming needs ^ Instructional media ' 

D D. Placem^ftt_V^ □ K. Primary roles of stude<^ 

' □ E. Student motivation \ □ L. Primaify roles of teacher 

□ F. Instructional sequence - □ -M. Instructional activities '* 
G. Pacing.'- , □ N^ Performance evaluation 

lb. Specific instructional strategies. More ^specifically, within this'^^^ructional approach, what 
strategies is it intende4<hat the present clirriculum program emphasize? (See Appendix B-3 for 
■ some possibilities within each approach.) 



\ 



Reasons. ' .\Vhy should these^mstructidnal strategies be emphasized? 

■ if' 



^orm 3D: page 1 of 2 



. PLANNINQ^PROGRAMEVALtJATION 
Foriti 3u - Instructional Approach (Continued)'^ </ 




V 



Part 2 - Set tin§4^bri ties for Fufther Planning 

3. RelatiVe-DrioritvA 




tions" 



d^j^h dM^^ements that mightW examined, }\6w highly related 



.with 



5 =,very hi^ly- related )*Bd 
1 = onlya little delated 



Writs the number 
in this box 



1 



Part 3 - Gathcririg and Using Evidence / ' 



^ Sources^ of data.. What sources of data will provide evidence ^bout whether these 
instructional strategics arc actually^ Emphasized in the present program? 




5. Judgment criteria. ^ How will the data collected by judged iritefpreted with respect to our 
Ijst of concerns and questions? ^ 




c 



Form 3D: page 2 of 2 



^. t'PLANNING A PROGRAM EVALtJTtfleN 
Form 3E - Program Support 



V- 



Part I ^-Clarifying Intended I^ro^ram Sypport 



Prbgram support operations. Check oae and compl,#te Item lb. 

Jtaffing arrangements 2 



\ 



□ A. (st 

□ B. Equipment 

□ C. Facilities 

□ D. Materials management 
d E. StiideHlgrouping'* 

□ F. Schedule*' ; 

□ Record keepings 



J. 




lb. Program support str^gies^ More specifically, within -this o pe rat icn^ what strategies is it 
. ^intended that the present* curricuUim program emphasize? (Se^Appehdix B-4 for some 
possibilities within each operation.) ^ 



V 




9 • -i 



Reasons. Why should these program support strategies be emphasized? 



V 



Forni 3E: page I of 2 



J PfcANNfi^G A PROQil^ EVALUATION 
Form 3E -J*rograin Suppbrt (Continued) 



PWoriti 



> ■ ■ ^ 

5. Relative i>riority. ^^Compared with other e^wnenWthaMtiight be examined, |iow hi^ly relfl^fed 
^ \-is this to obr concerns and questions?^' ^ . v ( :* 



Part 2 - Setting PWorities for Further Planning 



Use a rating scale of 1 to 5 with 
5 = very highly related and 



1 = only a little related .^ 



4- 




Write the number 
v in this box 



X 



■ ^ ' Part 3 - Gathering and Using Evidence 

4. . Sourb^olf data. What sources of data will provide evidence about whether these program 
sypport strategies are actually emphasized in the present program? 



5. Judgment critpri?. How wi 
list of concerns and qijestions? 



11 the data collected" be judged or interjlji 



eted with respect to our 



Form 3E: page 2 of 2 
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Appendix B 
Program Element Checklists 



• \ 



1 



-4. 



4 

/ 



Awo^d(abo|itthe^cfiecktists ^ . * : 

The1>fogram Element Checklists ifi this appendix have been excerpted from 
VurriciHum and Instm^iort: Ptanning Improvement, a trainin^ackage developed by 
Sharon Tumulty (Research for Better Sthools, 1978). Curmulum and Instrjiction 
h^s y^|deternjihe the specific kinds of program fmm-ovements to-be*ma(^e irfV 
curriculim or instruction of both. It includes a planningVrocess"whit:h stresses the 

^^curricurum program elements of student outcomes, curriculum content /ronterft 
seS^^ng, Hi^tructional approach^ and suppoft.systems (called-program support in 
th^nand'book). Planning A Progtam Evaluation: An Educator's Handbook has t^en 
desigf!?d St:ycpmpatib1e with the improvement apprgyh emphasized in^ 
Curriculum' aikd Instruction, You can 'begin your program f valuation v^th this 

^andboo^^n^ be -i^si^ed that your evaluation plan, and results will be helpful in 
developing plans for program improv^^jpt using Curnc^lum and Instruction. ^' ^ 



APPENDIX B-1 
CURRICULJUM CONTENT - SOURCE Al^D TYPES 



pse this checklist for help in completing Items la and lb on Form 3fi, 

Atademic-discipfines. Organizec^bo^es of\existing knowledge. 



□ A. 



B. 



C. 



□ 

□ • 

□ 

□ 

□ 



1. ' Terms , 

2. V Facts ' 

% 

3. Key concepts ' ^ 

4. Rules dtid relatnonships " t 

5. Methods and procedures^ 

^6. Principles and generalizations 
7. Other (specify) ^ 



Personal experiences. Experiences which are part of the student's daily 
life. 



□ 
□ 
□ 
□ 



Student interests or purposes 
Student activities 
Student choices and actions 
Personal roles and relatioijships 
Other (specify) 



Society. The broad environment of huma^i relationships, activities, and 
institutions. - , \ 



□ 
□ 
□ 
□ 
□ 
□ 
□ 



Life roles in*society 
Practical life skills 
Current events and issues . 
Social problems 
Social values 
Societal functions 
Other (specify) 



□ D. World of thoyght/ ^t'Mffl^,^^ used to develop, discover, clarify, 

tdst, oraRl^y kno^^ , i / ^ 

□ 1. ; ,Ipitfuc^ve rfel^ntojg processes . ' ^ , \ ^ / 

□ 2, D^i|5tive ihea!soniiig processes 



5% 



□ 3. Other (specify) . ^ 



r 



r ? 
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APPENDIX B-2 ^ 
CONTENT SEQUENCING - SOURCES AND PklNCIPLES 

Use this criecklist for help in completing Items lb and V on Form 3C. > 

Q ' A. Experience' or observation of the world. Content is sequenced ip terms 
, of.the way reality is organized. ' ^ ^ 

\ ' DM.- Chronotegical order - 

□ 2. . Spatial relationships ' ^ . • 
Q 3. Physical characteristics - / • - ' 

"c] 4. Other (specify)- ^ * ^ 

□ B. Logical structure of existing knowledge. Content is sequenced in teiins^ 
of the logical ways in which existing knowledge has. Cteen or can toe 
, , organized. / . \ 

' □ 1. Generalization to specific example. . ' >. 

□ 2. Specific example to generalization 

□ 3. Simple to complex 

□ 4. Cdficrete to abstract 

□ 5. Less refined'to more refined (spiral) 

□ 6. Rule/^eory/principle to application of rule/theon^rinciple 

□ 7. Pre-requisite order of concepts 

□ 8. Otherlspecify) " . / 

^ C. Methods of inteUectual inquiry:. Content is sequenced in terms of the 
step-by-step thinking procedures associated' with specific thinking strate- 
gies. ; 

□ 1 . Instances of generalization to discovery of generalization - 

□ 2. Hypothesis to testing of hypothesis . , 

□ 3. Generalization to application of generalizati6n in specific. 

instances \ ^ 

O 4. Other (specify y 



A^mptioji^ about the Psychology of learning. Content is sequenced in. 
terms experience or theory-based rules or assumptions about which 
coritent must , necessarily precede the'leai;ning of other, content, whjch 
consent is more likely to facilitato'learnirig, which content is .most 
copip^tible witffthe learner's level otfpsychologicaljsuidiness to learn. 

Q • 1. Pre-requisite order of skills^ 

Q -i2-. More wmiliar to less familiar 

□ • 3. • Less difficult' to ipore difficult 
X]< 4. ''Slore interesting t6 leSs interesting 

□ .5. Progressive stages of human developrhe'nt 

' □ • 6. Awareness/interest to intem^jjped attitude/value 

□ 7. Other (specify) 

' V 

Conditions under which laiowledge cduld be used.^ Content is sequenced 
in terms of degree of relevance to user needs, in terms of step-by-step 
procedures for performing a job or task or for solving problems, or in 
terms of potential frequencing of use. 

0 1 . High relevance to lesser relevance (personal, social or cateer) 

□ 2. Pre-req,uisites for job/t^sk performance ' 

□ 3.. Step-by-step problem-solving procedures ' 

□ 4. Higher frequency of use to lesser frequency <\f use 

□ 5. Other (specify) 




' APPENDIX BO • • ^ 

INSTRUCTIONAL APPROACHES AND STRATEGIES , . 

Use this checklist for help in completing Items 1 a and -Hd oh Form 3D. . * 

\ — ^ 

□ "A. Learning objective^ Specifying . desired student performance . in 
X behavioral terms. ^ - . * ^ "7 

1. Specified in advance ' ^ ' 

2. Related to instructional materials « ^ * 

* " '* } * ' 

3. Modified during instruction • . ^ V 
* < ■, 

4. Developed during instruction . w 

5. Unspecified / ' * * 

6. Other (specify) 

□ B. Assessment of lemming needs. Identifying student performance goals 

and/or problems 

□ 1 . Based on comparison with grout) norm « 

□ 2. Based on mastery of specific instructional obje^cti'ves 
"^D 3. Based on other objective criteria ^ 

, □ 4. Based on subjective criteria ' 

tD 5. Other (specify) 

□ C. DiagndMs of learning neefls. Analyzing particular student behaviors to be 

improvecland/or student learning characteristics. " ' 

'X, □ 1. xLeaVning prerequisites ^ 

• ^ ' Tj 2. Objectives already mastered by student 

^ □ 3. Student-error patterns. 

□ 4. Probable causes of learning difficulties 

□ 5. Physical, emotional, psychological, cognitive, social develop- 
, mcnt of student. ^ 

□ 6. Sfudoi)t learning preferences or interests 



□ 7... Student learnihg^ylt^s 

□ .8. Other jpspecifyK / \ 



y 



□ D. Placement, deciding where lo begin student instruction-. 

' * A ' V » , , . . ^ ; ' ^ . \ I 

t- . 1. /IndTvidual student perforrnaricc^n standardized^test # . 

. !v • ^ ' . . , X, \ 

y'^ .i-. □ 2; Jn^vidMal gtuctfe*nt perfomance on criterion-reftrrfcnced t 

* ' /□ . 3. /IndryiduaF student 'placement decisioits mal^ by; previous ' 
' . □ ^ 4.. Other^specify) ' "^r v'. ' ' . * ' . V 



E. Student movtiatidn. Encouraging student learning: . J ^ 

□ • 1/ Based oifstudent's nVed to achieve or su^ecd ^ 

□ ^ Based on studerit's^cuniosity or desire to explore 

□ ' 3. Based on student's interests 

□ " 4. Basi^d'on immediate and specific feedback on student's per- 
*formance ' . ' ' 



□ 5. Erased on general praise or approval . ^ * 
JJ ' 6. Based on material rewards ^ / ' . 

□ 7. "^^sed on acceptance b^ peer group, parents, or^teachers 

□ 8. Based on ihcreased student freedom of choice 

□ 9.^0ther.(specify) 

□ F. IviAtructionaf sequence. Organizing and/or varying the order of student 
^instruction. ° 

□ 1. Objectives: Fixed sequence^ ^ 

□ ^ 2. Objectives: Flexible sequence * 
^ ' □ 3. Objectives: Alternate sequences 

□ 4. Curriculum content: Fixed sequence 

Curriculum content: Flexible sequence 

□ 6. Curriculum content: Alternate sequences 

□ 7. Instructional activities: Fixed sequence • / • tlS 
'. . -1 < ■' . * K'^ 



□ 8. Instructional activities: Flexible sequence 
' O 9. Instructional activities: Alternate sequences 



se^u 



□ 10. Other (specify) 
□ G. Pacing. Determining the rate of student progress through the instruc- 



tional 


sequence. 


□ 


1. 


Group paced 


□ 


2. 


Individually paced 




3. 


Student self-pace^ 


□ 


4. 


Other (specify) 



□■ H. Instructional methods. ' Engaging- students in the learning process. 



\ 



□ 


1. 


Drill and practice 


□ 


2. 


Programmed instruction 






Lectlbe (presentation by teacher) 


□ 


4. 


Demonstration « ^ 


□ 


5. 


Explanation 




6. 


Question and answer , 


□ 


7. 


Discussion 


. □ 


•8. 


Group problem solving 




9. 


Guided discovery ' i 


□ 


10. 


Inquiry 


□ 


11. 


Direct expesience • 


□ 


12. 


Simulation, role play . * ^ ^ 


□ 


13. 


Computer, programmed learning machine 


□ 


14. 


Other (specify) " 



□ I.. Instructional settings. - Establishing appropriate student learning sit- 
uations. 

□ 1. Self-instructional study (study by oneselO 



0 2. Teacher tutoring 
Ho . 



ERIC 



' • — L _ — - 

□ 3. PeerXstudentl tutoring 

□ , 4. Smairgroup instruction 

□ 5. Large group instruction 

□ 6. Seminar 

□ 1. Independent study (self-directed study independent of regularly 

structured curriculum) 

□ 8. Other (specify) 

Instructional media. Presenting instructjonal content^n print, audio- 
visual, or manipulative form. ^ ■ 

□ 1 . Prinfed texts,jTOrkbooks, learning activity packs, etc. 

□ 2. Visual: sl^sT^ilms, film loops, filiffstrips, television, video- 

tapes, exhibits or displays, posters^d charts, overhead trans- 
parencies - 

□ 3. Audio: tape cassettes, tape recordings, radio, records - 

□ 4. ''XlamDuljitive: objects, models, kits 

□ 5. Otn^Rpecify) 

Primary roles of student. Specifying how the student should function in 
the J^amirig environment. ^ \ 

□ 1. Accept direction 

JD ' 2. ^similate information 

□ 3. Prac?tice ^ 

□ ' 4. Integrate and process information- y _ - 
D 5. Solve problems 

□ ^ 6. Interact with others ' . 

□ . 7. Pursue individual interests 

□ 8. Cooperate in planning learning activities 
'□ , 9. Manage learning activities 

□ LO. Assess learning^ progress 

□ 11. Select learning materials 

□ 12. Other (specify) 





f 



p ' L. : Primary roles of teacherT Snecifying how the teacher should function in 
the learning environment. ' 

Provide direction 

Provide information 

Analyze or interpret 'inforfnation 

Guide or facilitate discussioTr^ ^ . 

Demonstrate » • • • 

Motivate students 



Prescribe learning activities 
Tutor indivmualstudents 
Assess student^TOgress 
Provide enrichment 



□ 


1. 


□ 


f 


□ 


3.. 


□ 


4. 


□ 


5. 


□ 


6. 


□ 


* 7. 




8. 


□ 


9. 


□ 


10. 


□ 


11. 




12. 


□ 


13. 



□ M. Instructional activities. Specifying how the student should interact with 
the teacher, other students. and/6r»media. 

□ 1. Reciting 

□ 2. Reading 

§□ 3. , Listenijig ^ 

( □ 4.'. Writing- 

D 5. Responding to questions 

□ 6. Questioning / ^ ^ 

□ I 7. Working with printed texts, worksheets, exercises 

□ 8. Working with multi-media learning materials , 
' ' □ 9 . Conferring with teacher or another student 

□ • JO.' Participating in group discussion ' ' '.^ 

□ '11. Discovfcring throligh ^hands on'.' experience • . 
118 ^ □ 12. Researching or investigating 



'9' 



ERIC 



_ ^ ^ .0 13 . " * 

'□ ; 14/ Planning and conducting projects 

□ 15. Participating in games , 

□ 16. Paiticipating in field trips 

□ 17. Other (specify) 

□ N, Perfoiinance evaluation. Gathering ihfomiatioH about student progress 
, and student needs. , - 

□ 1. Frequent evaluation ^ 
, El 2. ^^.Infrequent evaluation 

D ' 3. Broad content mastery evaluated 

□ 4. Miastery of small units of content evaluated 

□ 5. Mastery of individual objectives evaluated 
- □ 6. Affective development evaluated ' ^ 

7. Other (speciTj') 



EKLC 



□ 
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. APPENDIX B-4 

PROGRAM SUPPORT - OPERATIONS AND STRATEGIES 



Use this checklist for help in completing Items la and lb on F orm 3E. 

□ A. ' Staffing arrangements. Organising staff to make optimal use of their 
knowledge and skills. % 
' □ 1 . Subject matter assignments 

□ a. Self-contained classroom. One teachei'fcJr all subjects. 

□ b. Departmentalized. Different teacher for each s\ibject. 

□ c. Semi-departmentalized, Different teacher for each 

subject except for several subjects which are com-^ 
bined in a core culrici^um. 

□ d. Other (specify) , 
□. 2. Planning of instruction 

□ a. Plans on individual basis 

□ b.» Several teachers engage in cooperati>re planning. 

Independent in terms of actual instruction. 

□ c Team of teachers engage in cooperative planning. Still 

independent in terms of actual instruction. 

□ d. Other (specify) 

□ 3. Responsibility for instruction ; 

□ a. Individual teacher instructs students. 

□ b. Several teachers exchange some students fot instruc- 

tion. 

, □ c. ' Several teachers conduct joint instruction. 

□ d. Team of teachers share instructional tasks. 

functions based on differences in preparation, m^^^ 
ests, etc. . 

« 

□ e. Other (specify) 



□ 4. Instructional roles - ' 

□ a. Team leader with some administrative responsibilities. 
• Master teacher, unit, leader, etC'. 

, b. Specialist ieacher 

c. • Regular staff teacher 

□ . d. Student intern. Student teacher 

□ ■ e. Instructional aide. Paraprofessional, paid or volunteer. 

□ f. other (specify) 

♦ 

□ 5. ' Support roles 

□ a. Educational specialist. Subject matter expert, curricu- 

lum coordinator, evaluator ceunselor, etc. 

□ b. ■■ Media specialist. Media dfesign specialist, audiovisual 

technician, etc. 

□ c. Consultant. Materials managemeht* inventor5f%nd 

ordering, etc. 

□ d. Aide. > 

- □ e. aerkr typist. 

# 

□ f. Other (specify) 

Equipment. Arranging equipment t04)rovide flexible support for instriic- 

instruction! - ' 0 

" . ^ . -- 

□ 1. . Mobility of equipment 

□ a. Portable media equipment. Filmstrip, fj^m or over- 

head projectors, record or tape players, etc. 

□ o b. Fixed or stationary media equipnaent. Large screen 
, . projectors, central audio source, etc. 

□ c. , Fixed furnishings. 

□ d. Movable fu/nishings. • 

□ e. Fixed storage or supply cabinets. ^ 

□ , f. Movable storage or supply cabinets, carts, etc. 

□ g. Other (Specify) ' . 
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♦ □ 2. Special arrangements and conditions ^ 

□ a. Special fixtures/outlets, etc. 

□ b. Limited compatibility* of equipment. Size of video- ' 
; ' tape accepted by different recorders, etc. 

^ □ c. Full compatibility ofequipmenL 

□ ,. d. ' Other (specify) ^ 

. . 10 , . \ ' 

□ C. Facilities. Providing diversified learning space to- accommodWe various 
instructional purposes and learning styles. 
□ 1 . Functional learning space) \ 

> □ a. Media area for use by individual students. Viewing, 
listening carrels, etc. "7*" 

□ b. Media ^rea for use 'by groups of students. Film 

theater,, etc. 

□ c. Quiet area for independent study. 

□ d. Quiet area ror reading. 

□ e. Grbup meeting ot discussion area. 

□ f. Selected area for tutoring or individual conferences. 

□ g. General learning space for lecture, large'group dem- 

onstration, discussion. 

' □ h. , High physical activity area. 

□ i. Laboratory area. 

□ j. Accessible area for scoring/correction of student 
- tests, etc' " 

• □ k. Community sites. ^ 

1. Industrial sites. ' • , ; * 
%■ 

□ m. Other (specify) 

□ 2. Flexibility of learning space / j • 

. ^ . p a. Trajjitional classroom (fixed room arrangement). 

□ b. Traditional classroom (flexible room arragement)* 
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□ c. Multi-purpose room. General learning spacr with 

portable dividers. 

□ d. Learning resource center. 

□ ^ e. ^ Special purpose center. Writing center, etc. - 

□ f. Open spacie area. 

□ g. Other (Specify) 

□ 3. Accessibility of learning space 

^ □ a. Near to learning resource, center or library. 

□ b. . Near to materials and/or equipment storajge areas. 

□ c. Near to other functional learning areas ^ 

□ J. Other (specify) ^ 

O 4. Special arrangements or environmental conditions 

♦ 

□ a. Laboratories (Science). 

□ b. Learning laboratories. 

□ c. ^Special teacher/aide stations. 

□ d. Special lighting, acoustics, furniture, etc. 

D e. Other (specify) , 

b. Materiak management. Insuring that learning materials are available and 
accessible when tieeded by teachers and by students. 

□ 1 . Accessibility of materials ^ 

□ a. Central storage of materials. 



□ b. Decentralized storagewof materials. 

r * 

□ c. Portable storage of materials. 



6. 



□ d. Materials accessible to teachers onlh. 

□ e. Materials accessible to teachers and a-id^s. 

s □ f. Materials accessible to teachers, aides, and students. 

X □ g. Other (specify) 
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□ 2. Orderinjg and replacement of materials 

a af Frequent inventory and replacement of materials by 
/ , - teacher or aide., 

□ . b. Infrequent inventory and replacement of materials, 

□ c. Other (specify) - • 

□ 3. Variety of materials 

□ : a. Variety of^ alternative materials in case of high 

demand and Umited supply. 

□ b. Limited variety of alternative materials. 

□ c. Other (specify) 

Student grouping. Organizing students to facilitale their progress 
through the curriculum and to provide individual students with maximum 
opportunities for academic, personal, ^ social development. 

□ 1 . Vertical grouping ^ 

P a. Traditional age-graded system 

□ b. Multi-age or multi-graded system 

□ a Nongraded system. Continuous progress. 

□ d. Other (specify) 

□ 2. Horizontal groupiilg: Inter-class 

□ a. Homogeneous. Based on likeness in terms of age, 

interests, ability, achievement or performance, learn- 
ing style, learning difficulties, etc. 

□ ' b. Heterogeneous. Social integration of student popula- 

tion, activities, projects^ etc. ^ 

□ c.* Individual alone 

□ d. Other (specify) ' 

□ 3. Horizontal grouping: Intra-class ' 

□ a. Homogeneous 

□ b. Heterogeneous 



□ c. Individual alone 

□ d ' Other (specify) 

□ 4. Frequency of Regrouping . i . 

□ a. Frequent regrouping 

□ b. Occasional regrouping 

□ c. Little or no regrouping 

□ d. Other (specify) 

□ 5. Basis for regrouping 

□ a. General observation of overall needs of students as a 

group. ' 

□ b. Regular review of individual student's performance in 

terms bf group norm^. 

□ c. Individual student's ipastery of specific objectives. 

□ d. Diagnosis of individual student's learning difficulties. 

'» 

□ e. Differences in individual learning style, motivation, 

etc. ' . 

□ f. Student interests and performances. . 
pi * ■ 

□ g. Student review and diagnosis of own performance. 

□ h. dther (specify) 

Schedule-tailoring time to instructional requirements. ^ 

□ 1. Flexibility of schedule 

□ a. Fixed. I^egularly scheduled class periods. 

□ b. Variabjif or modu^r. Flexibility scheduled blocks of 
• ^ time. 

c. ^fl>5ed. Some regularly scheduled, some flexibly 

^ *fe^eduled: 

□ d. Open. Unscheduled* , 

□ e. Other (specify) 



